Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.............X......X.........X...X.......X.......X.......X.] duration:
1.872104763s
FAIL (2025-08-10 00:32:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 00:32:34.551433064 (31h6m28.982513195s) [upload=32456]: Starting upload
Aug 10 00:32:34.551479853 (31h6m28.982559974s) [upload=32456]: Done starting upload
Aug 10 00:32:34.551541291 (31h6m28.982621412s) [upload=32456]: Uploading segments...
Aug 10 00:32:34.551633788 (31h6m28.982713909s) [upload=32456]: Got next segment. Inline: true
Aug 10 00:32:34.551639058 (31h6m28.982719189s) [upload=32456]: Waiting for error group managing segments...
Aug 10 00:32:34.551697509 (31h6m28.98277764s) [upload=32456]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:32:34.551705415 (31h6m28.982785546s) [upload=32456]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 00:32:34.551708030 (31h6m28.982788161s) [upload=32456]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:32:34.822366843 (31h6m29.253446964s) [upload=32456]: Done uploading segments...
Aug 10 00:32:34.822385970 (31h6m29.253466101s) [upload=32456]: Upload finished. err: <nil>
Duration: 1.872127447s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..............X......X.........X...X.......X.......X.......X] duration:
1.653779645s
FAIL (2025-08-10 00:32:35 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 10 00:32:34.551433064 (31h6m28.982513195s) [upload=32456]: Starting upload
Aug 10 00:32:34.551479853 (31h6m28.982559974s) [upload=32456]: Done starting upload
Aug 10 00:32:34.551541291 (31h6m28.982621412s) [upload=32456]: Uploading segments...
Aug 10 00:32:34.551633788 (31h6m28.982713909s) [upload=32456]: Got next segment. Inline: true
Aug 10 00:32:34.551639058 (31h6m28.982719189s) [upload=32456]: Waiting for error group managing segments...
Aug 10 00:32:34.551697509 (31h6m28.98277764s) [upload=32456]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:32:34.551705415 (31h6m28.982785546s) [upload=32456]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 10 00:32:34.551708030 (31h6m28.982788161s) [upload=32456]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:32:34.822366843 (31h6m29.253446964s) [upload=32456]: Done uploading segments...
Aug 10 00:32:34.822385970 (31h6m29.253466101s) [upload=32456]: Upload finished. err: <nil>
Duration: 1.653809913s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...X..XX......X..........X.............X.......X............] duration:
8.644237508s
FAIL (2025-08-10 00:32:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 8.64426492s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [....X..XX......X..........X.............X.......X...........] duration:
7.4290387s
FAIL (2025-08-10 00:31:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 7.429072655s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.....X..XX......X..........X.............X.......X..........] duration:
10.849778043s
FAIL (2025-08-10 00:31:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 10.849800727s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...............X......X.........X...X.......X.......X.......] duration:
1.851372946s
FAIL (2025-08-10 00:31:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:26:25.206020461 (31h0m19.637100592s) [upload=32350]: Starting upload Aug 10 00:26:25.206080506 (31h0m19.637160637s) [upload=32350]: Done starting upload Aug 10 00:26:25.206150179 (31h0m19.63723031s) [upload=32350]: Uploading segments... Aug 10 00:26:25.206197499 (31h0m19.63727763s) [upload=32350]: Got next segment. Inline: true Aug 10 00:26:25.206202789 (31h0m19.63728292s) [upload=32350]: Waiting for error group managing segments... Aug 10 00:26:25.206242866 (31h0m19.637322997s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:26:25.206248156 (31h0m19.637328297s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:26:25.206251533 (31h0m19.637331664s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:26:25.425220889 (31h0m19.85630102s) [upload=32350]: Done uploading segments... Aug 10 00:26:25.425243392 (31h0m19.856323523s) [upload=32350]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.851400388s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [X...............X......X.........X...X.......X.......X......] duration:
2.050044022s
FAIL (2025-08-10 00:30:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:26:25.206020461 (31h0m19.637100592s) [upload=32350]: Starting upload Aug 10 00:26:25.206080506 (31h0m19.637160637s) [upload=32350]: Done starting upload Aug 10 00:26:25.206150179 (31h0m19.63723031s) [upload=32350]: Uploading segments... Aug 10 00:26:25.206197499 (31h0m19.63727763s) [upload=32350]: Got next segment. Inline: true Aug 10 00:26:25.206202789 (31h0m19.63728292s) [upload=32350]: Waiting for error group managing segments... Aug 10 00:26:25.206242866 (31h0m19.637322997s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:26:25.206248156 (31h0m19.637328297s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:26:25.206251533 (31h0m19.637331664s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:26:25.425220889 (31h0m19.85630102s) [upload=32350]: Done uploading segments... Aug 10 00:26:25.425243392 (31h0m19.856323523s) [upload=32350]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.05007954s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [......X..XX......X..........X.............X.......X.........] duration:
7.008438975s
FAIL (2025-08-10 00:30:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 7.008476426s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.......X..XX......X..........X.............X.......X........] duration:
7.471114071s
FAIL (2025-08-10 00:30:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 7.471136005s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.X...............X......X.........X...X.......X.......X.....] duration:
1.94962464s
FAIL (2025-08-10 00:29:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:26:25.206020461 (31h0m19.637100592s) [upload=32350]: Starting upload Aug 10 00:26:25.206080506 (31h0m19.637160637s) [upload=32350]: Done starting upload Aug 10 00:26:25.206150179 (31h0m19.63723031s) [upload=32350]: Uploading segments... Aug 10 00:26:25.206197499 (31h0m19.63727763s) [upload=32350]: Got next segment. Inline: true Aug 10 00:26:25.206202789 (31h0m19.63728292s) [upload=32350]: Waiting for error group managing segments... Aug 10 00:26:25.206242866 (31h0m19.637322997s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:26:25.206248156 (31h0m19.637328297s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:26:25.206251533 (31h0m19.637331664s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:26:25.425220889 (31h0m19.85630102s) [upload=32350]: Done uploading segments... Aug 10 00:26:25.425243392 (31h0m19.856323523s) [upload=32350]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.949654387s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X...............X......X.........X...X.......X.......X....] duration:
2.069036842s
FAIL (2025-08-10 00:29:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:26:25.206020461 (31h0m19.637100592s) [upload=32350]: Starting upload Aug 10 00:26:25.206080506 (31h0m19.637160637s) [upload=32350]: Done starting upload Aug 10 00:26:25.206150179 (31h0m19.63723031s) [upload=32350]: Uploading segments... Aug 10 00:26:25.206197499 (31h0m19.63727763s) [upload=32350]: Got next segment. Inline: true Aug 10 00:26:25.206202789 (31h0m19.63728292s) [upload=32350]: Waiting for error group managing segments... Aug 10 00:26:25.206242866 (31h0m19.637322997s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:26:25.206248156 (31h0m19.637328297s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:26:25.206251533 (31h0m19.637331664s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:26:25.425220889 (31h0m19.85630102s) [upload=32350]: Done uploading segments... Aug 10 00:26:25.425243392 (31h0m19.856323523s) [upload=32350]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.069060498s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [........X..XX......X..........X.............X.......X.......] duration:
7.657639482s
FAIL (2025-08-10 00:29:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 7.657668607s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X...............X......X.........X...X.......X.......X...] duration:
1.83779206s
FAIL (2025-08-10 00:28:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:26:25.206020461 (31h0m19.637100592s) [upload=32350]: Starting upload Aug 10 00:26:25.206080506 (31h0m19.637160637s) [upload=32350]: Done starting upload Aug 10 00:26:25.206150179 (31h0m19.63723031s) [upload=32350]: Uploading segments... Aug 10 00:26:25.206197499 (31h0m19.63727763s) [upload=32350]: Got next segment. Inline: true Aug 10 00:26:25.206202789 (31h0m19.63728292s) [upload=32350]: Waiting for error group managing segments... Aug 10 00:26:25.206242866 (31h0m19.637322997s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:26:25.206248156 (31h0m19.637328297s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:26:25.206251533 (31h0m19.637331664s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:26:25.425220889 (31h0m19.85630102s) [upload=32350]: Done uploading segments... Aug 10 00:26:25.425243392 (31h0m19.856323523s) [upload=32350]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.837819521s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.........X..XX......X..........X.............X.......X......] duration:
7.892331983s
FAIL (2025-08-10 00:28:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 7.892362652s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [....X...............X......X.........X...X.......X.......X..] duration:
1.830368657s
FAIL (2025-08-10 00:28:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:26:25.206020461 (31h0m19.637100592s) [upload=32350]: Starting upload Aug 10 00:26:25.206080506 (31h0m19.637160637s) [upload=32350]: Done starting upload Aug 10 00:26:25.206150179 (31h0m19.63723031s) [upload=32350]: Uploading segments... Aug 10 00:26:25.206197499 (31h0m19.63727763s) [upload=32350]: Got next segment. Inline: true Aug 10 00:26:25.206202789 (31h0m19.63728292s) [upload=32350]: Waiting for error group managing segments... Aug 10 00:26:25.206242866 (31h0m19.637322997s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:26:25.206248156 (31h0m19.637328297s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:26:25.206251533 (31h0m19.637331664s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:26:25.425220889 (31h0m19.85630102s) [upload=32350]: Done uploading segments... Aug 10 00:26:25.425243392 (31h0m19.856323523s) [upload=32350]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.830389838s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.....X...............X......X.........X...X.......X.......X.] duration:
1.879186468s
FAIL (2025-08-10 00:27:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:26:25.206020461 (31h0m19.637100592s) [upload=32350]: Starting upload Aug 10 00:26:25.206080506 (31h0m19.637160637s) [upload=32350]: Done starting upload Aug 10 00:26:25.206150179 (31h0m19.63723031s) [upload=32350]: Uploading segments... Aug 10 00:26:25.206197499 (31h0m19.63727763s) [upload=32350]: Got next segment. Inline: true Aug 10 00:26:25.206202789 (31h0m19.63728292s) [upload=32350]: Waiting for error group managing segments... Aug 10 00:26:25.206242866 (31h0m19.637322997s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:26:25.206248156 (31h0m19.637328297s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:26:25.206251533 (31h0m19.637331664s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:26:25.425220889 (31h0m19.85630102s) [upload=32350]: Done uploading segments... Aug 10 00:26:25.425243392 (31h0m19.856323523s) [upload=32350]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.879218578s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..........X..XX......X..........X.............X.......X.....] duration:
8.91955779s
FAIL (2025-08-10 00:26:54 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 8.919598248s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [......X...............X......X.........X...X.......X.......X] duration:
859.588196ms
FAIL (2025-08-10 00:26:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:26:25.206020461 (31h0m19.637100592s) [upload=32350]: Starting upload Aug 10 00:26:25.206080506 (31h0m19.637160637s) [upload=32350]: Done starting upload Aug 10 00:26:25.206150179 (31h0m19.63723031s) [upload=32350]: Uploading segments... Aug 10 00:26:25.206197499 (31h0m19.63727763s) [upload=32350]: Got next segment. Inline: true Aug 10 00:26:25.206202789 (31h0m19.63728292s) [upload=32350]: Waiting for error group managing segments... Aug 10 00:26:25.206242866 (31h0m19.637322997s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:26:25.206248156 (31h0m19.637328297s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:26:25.206251533 (31h0m19.637331664s) [upload=32350]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:26:25.425220889 (31h0m19.85630102s) [upload=32350]: Done uploading segments... Aug 10 00:26:25.425243392 (31h0m19.856323523s) [upload=32350]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.616211ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...........X..XX......X..........X.............X.......X....] duration:
8.160288895s
FAIL (2025-08-10 00:25:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 8.160313463s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X...............X......X.........X...X.......X.......] duration:
1.842079817s
FAIL (2025-08-10 00:25:13 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab0df287d5173e12923fd4bcb2ac1af1954b942c1f2b8c1f518babbc1daa4d3f != before 77903e616961380dd63f34728bf96c673069b77d680ad5c3e6fe262dfa40ac55 ======LOGS====== Aug 10 00:20:16.341232354 (30h54m10.772312475s) [upload=32251]: Starting upload Aug 10 00:20:16.341281188 (30h54m10.772361319s) [upload=32251]: Done starting upload Aug 10 00:20:16.341326124 (30h54m10.772406255s) [upload=32251]: Uploading segments... Aug 10 00:20:16.341357244 (30h54m10.772437375s) [upload=32251]: Got next segment. Inline: true Aug 10 00:20:16.341360831 (30h54m10.772440962s) [upload=32251]: Waiting for error group managing segments... Aug 10 00:20:16.341393773 (30h54m10.772473904s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:20:16.341397470 (30h54m10.772477601s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:20:16.341399945 (30h54m10.772480076s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:20:17.187110140 (30h54m11.618190311s) [upload=32251]: Done uploading segments... Aug 10 00:20:17.187130970 (30h54m11.618211101s) [upload=32251]: Upload finished. err: <nil>
Duration: 1.842104806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [............X..XX......X..........X.............X.......X...] duration:
6.882876048s
FAIL (2025-08-10 00:24:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 6.882922568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X...............X......X.........X...X.......X......] duration:
1.860677961s
FAIL (2025-08-10 00:24:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab0df287d5173e12923fd4bcb2ac1af1954b942c1f2b8c1f518babbc1daa4d3f != before 77903e616961380dd63f34728bf96c673069b77d680ad5c3e6fe262dfa40ac55 ======LOGS====== Aug 10 00:20:16.341232354 (30h54m10.772312475s) [upload=32251]: Starting upload Aug 10 00:20:16.341281188 (30h54m10.772361319s) [upload=32251]: Done starting upload Aug 10 00:20:16.341326124 (30h54m10.772406255s) [upload=32251]: Uploading segments... Aug 10 00:20:16.341357244 (30h54m10.772437375s) [upload=32251]: Got next segment. Inline: true Aug 10 00:20:16.341360831 (30h54m10.772440962s) [upload=32251]: Waiting for error group managing segments... Aug 10 00:20:16.341393773 (30h54m10.772473904s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:20:16.341397470 (30h54m10.772477601s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:20:16.341399945 (30h54m10.772480076s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:20:17.187110140 (30h54m11.618190311s) [upload=32251]: Done uploading segments... Aug 10 00:20:17.187130970 (30h54m11.618211101s) [upload=32251]: Upload finished. err: <nil>
Duration: 1.860702839s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.........X...............X......X.........X...X.......X.....] duration:
1.854132996s
FAIL (2025-08-10 00:24:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab0df287d5173e12923fd4bcb2ac1af1954b942c1f2b8c1f518babbc1daa4d3f != before 77903e616961380dd63f34728bf96c673069b77d680ad5c3e6fe262dfa40ac55 ======LOGS====== Aug 10 00:20:16.341232354 (30h54m10.772312475s) [upload=32251]: Starting upload Aug 10 00:20:16.341281188 (30h54m10.772361319s) [upload=32251]: Done starting upload Aug 10 00:20:16.341326124 (30h54m10.772406255s) [upload=32251]: Uploading segments... Aug 10 00:20:16.341357244 (30h54m10.772437375s) [upload=32251]: Got next segment. Inline: true Aug 10 00:20:16.341360831 (30h54m10.772440962s) [upload=32251]: Waiting for error group managing segments... Aug 10 00:20:16.341393773 (30h54m10.772473904s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:20:16.341397470 (30h54m10.772477601s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:20:16.341399945 (30h54m10.772480076s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:20:17.187110140 (30h54m11.618190311s) [upload=32251]: Done uploading segments... Aug 10 00:20:17.187130970 (30h54m11.618211101s) [upload=32251]: Upload finished. err: <nil>
Duration: 1.854160128s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.............X..XX......X..........X.............X.......X..] duration:
9.309431419s
FAIL (2025-08-10 00:24:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 9.30947396s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..........X...............X......X.........X...X.......X....] duration:
2.066579917s
FAIL (2025-08-10 00:23:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab0df287d5173e12923fd4bcb2ac1af1954b942c1f2b8c1f518babbc1daa4d3f != before 77903e616961380dd63f34728bf96c673069b77d680ad5c3e6fe262dfa40ac55 ======LOGS====== Aug 10 00:20:16.341232354 (30h54m10.772312475s) [upload=32251]: Starting upload Aug 10 00:20:16.341281188 (30h54m10.772361319s) [upload=32251]: Done starting upload Aug 10 00:20:16.341326124 (30h54m10.772406255s) [upload=32251]: Uploading segments... Aug 10 00:20:16.341357244 (30h54m10.772437375s) [upload=32251]: Got next segment. Inline: true Aug 10 00:20:16.341360831 (30h54m10.772440962s) [upload=32251]: Waiting for error group managing segments... Aug 10 00:20:16.341393773 (30h54m10.772473904s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:20:16.341397470 (30h54m10.772477601s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:20:16.341399945 (30h54m10.772480076s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:20:17.187110140 (30h54m11.618190311s) [upload=32251]: Done uploading segments... Aug 10 00:20:17.187130970 (30h54m11.618211101s) [upload=32251]: Upload finished. err: <nil>
Duration: 2.066630363s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...........X...............X......X.........X...X.......X...] duration:
1.902905876s
FAIL (2025-08-10 00:23:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab0df287d5173e12923fd4bcb2ac1af1954b942c1f2b8c1f518babbc1daa4d3f != before 77903e616961380dd63f34728bf96c673069b77d680ad5c3e6fe262dfa40ac55 ======LOGS====== Aug 10 00:20:16.341232354 (30h54m10.772312475s) [upload=32251]: Starting upload Aug 10 00:20:16.341281188 (30h54m10.772361319s) [upload=32251]: Done starting upload Aug 10 00:20:16.341326124 (30h54m10.772406255s) [upload=32251]: Uploading segments... Aug 10 00:20:16.341357244 (30h54m10.772437375s) [upload=32251]: Got next segment. Inline: true Aug 10 00:20:16.341360831 (30h54m10.772440962s) [upload=32251]: Waiting for error group managing segments... Aug 10 00:20:16.341393773 (30h54m10.772473904s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:20:16.341397470 (30h54m10.772477601s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:20:16.341399945 (30h54m10.772480076s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:20:17.187110140 (30h54m11.618190311s) [upload=32251]: Done uploading segments... Aug 10 00:20:17.187130970 (30h54m11.618211101s) [upload=32251]: Upload finished. err: <nil>
Duration: 1.902932277s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..............X..XX......X..........X.............X.......X.] duration:
9.653602746s
FAIL (2025-08-10 00:23:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 9.653630408s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [............X...............X......X.........X...X.......X..] duration:
2.132654035s
FAIL (2025-08-10 00:22:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab0df287d5173e12923fd4bcb2ac1af1954b942c1f2b8c1f518babbc1daa4d3f != before 77903e616961380dd63f34728bf96c673069b77d680ad5c3e6fe262dfa40ac55 ======LOGS====== Aug 10 00:20:16.341232354 (30h54m10.772312475s) [upload=32251]: Starting upload Aug 10 00:20:16.341281188 (30h54m10.772361319s) [upload=32251]: Done starting upload Aug 10 00:20:16.341326124 (30h54m10.772406255s) [upload=32251]: Uploading segments... Aug 10 00:20:16.341357244 (30h54m10.772437375s) [upload=32251]: Got next segment. Inline: true Aug 10 00:20:16.341360831 (30h54m10.772440962s) [upload=32251]: Waiting for error group managing segments... Aug 10 00:20:16.341393773 (30h54m10.772473904s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:20:16.341397470 (30h54m10.772477601s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:20:16.341399945 (30h54m10.772480076s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:20:17.187110140 (30h54m11.618190311s) [upload=32251]: Done uploading segments... Aug 10 00:20:17.187130970 (30h54m11.618211101s) [upload=32251]: Upload finished. err: <nil>
Duration: 2.132683543s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...............X..XX......X..........X.............X.......X] duration:
8.202323781s
FAIL (2025-08-10 00:21:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 00:21:51.426692800 (30h55m45.857772931s) [upload=32277]: Starting upload
Aug 10 00:21:51.426852746 (30h55m45.857932877s) [upload=32277]: Done starting upload
Aug 10 00:21:51.427015878 (30h55m45.858095999s) [upload=32277]: Uploading segments...
Aug 10 00:21:51.427047598 (30h55m45.85812773s) [upload=32277]: Got next segment. Inline: false
Aug 10 00:21:51.427069310 (30h55m45.858149441s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:21:51.427073208 (30h55m45.858153339s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:21:51.877299418 (30h55m46.308379549s) [seg_pos={0 0}, upload=32277]: Begin upload segment...
Aug 10 00:21:51.877347851 (30h55m46.308427982s) [seg_pos={0 0}, upload=32277]: Done begin upload segment.
Aug 10 00:21:51.877370635 (30h55m46.308450766s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877731936 (30h55m46.308812067s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.877971044 (30h55m46.309051175s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878027492 (30h55m46.309107623s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878056377 (30h55m46.309136508s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878301065 (30h55m46.309381196s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878406977 (30h55m46.309487108s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878552837 (30h55m46.309632958s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878686232 (30h55m46.309766363s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878763860 (30h55m46.309843991s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.878952170 (30h55m46.310032291s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879223059 (30h55m46.31030318s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879476413 (30h55m46.310556534s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879686265 (30h55m46.310766396s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.879884915 (30h55m46.310965046s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880094997 (30h55m46.311175128s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880300330 (30h55m46.311380461s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:51.880523026 (30h55m46.311603157s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Uploading piece...
Aug 10 00:21:52.976950611 (30h55m47.408030742s) [upload=32277]: Next returned nil segment
Aug 10 00:21:52.977065491 (30h55m47.408145622s) [upload=32277]: Waiting for error group managing segments...
Aug 10 00:21:53.258208514 (30h55m47.689288635s) [noise=true , address=79.127.205.234:4615 , piece_id=PBJHGFS4O37KO3ZWG5TS67ELONVO57ZBS44OGUFIYIDGGSNYAEAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.262269374 (30h55m47.693349495s) [noise=true , address=64.49.13.26:4956 , piece_id=63PN76PIPLOUGIFBLGEQQHUC5D5ED3JUYMGXTDYCKV3JCBX55HDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.828481423 (30h55m48.259561544s) [noise=true , address=104.36.82.59:4324 , piece_id=VWJ4MCSIAXRJV4U5X2GTXMCOO3BSPKVRSLTUEW52V5VW6IKAAKRQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.873644664 (30h55m48.304724795s) [noise=true , address=104.36.82.3:4778 , piece_id=L52AXPRCD4AF2HJV766KLHZX2DY2QWAQLSIF7FMPTGFCTMSZY6FQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.883801176 (30h55m48.314881327s) [noise=true , address=104.36.82.7:4916 , piece_id=47TQE3KXEREVDH52CGPMRN36O5F442HCFYYJX6M7NSXCFRP4GCCQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.898776118 (30h55m48.329856249s) [noise=true , address=104.36.82.37:4684 , piece_id=Z6SEIA5YBSOE7ZDJPWFJAJ36YB2KMEIR2UY432VQPSJ5YMK62QIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.918718333 (30h55m48.349798464s) [noise=true , address=104.36.82.58:4278 , piece_id=33NHMR6HGMTQKU7NWXFHGNGDNWASP2BFSK666TOWJHQR5Z6SL5HQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.938305931 (30h55m48.369386062s) [noise=true , address=104.36.82.2:4741 , piece_id=K3SVB3OIRYHPWNL3CIYKOYYVMBF6AJIIULIBN7ZM3MCGTPSSUPDA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.966449418 (30h55m48.397529549s) [noise=true , address=104.36.82.43:4860 , piece_id=33KKQW5TFET4FSUWUTQQ36SBABTZVGG7D4F5WJDWSYZ2MYSOZPSQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:53.974079997 (30h55m48.405160128s) [noise=true , address=104.36.82.18:4368 , piece_id=IMVO2BGYDNXLJLXZUS7E5IJ4IHYZRHJLYEUEY2NCPBBOHJISJQ6Q, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.082223991 (30h55m48.513304112s) [noise=true , address=104.36.82.46:4509 , piece_id=254Q4ZNBZP4JHPB42GQV2CNSMMQ5RL3F6L7LNJH2HAVHT3HR23BA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:54.146122459 (30h55m48.57720259s) [noise=true , address=104.36.82.9:4012 , piece_id=E5ERHKCNVVSVUURMND2SSSOSFFLSPXCA2QWC6NAXUH5EYJZVQRAA, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:57.510852077 (30h55m51.941932208s) [noise=true , address=104.36.82.8:4000 , piece_id=WY7ZULAK3FUVRZDYKGZJI7JGSKAYTRF3L7IHNB7CSIQGCLXEOMAQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218749704 (30h55m52.649829835s) [noise=true , address=104.36.82.38:4716 , piece_id=BROUAZR2WIRHETURGQEEKMXPIIZMR4ZF5COJN5HMR7VQLSFR2IDQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: <nil>
Aug 10 00:21:58.218772107 (30h55m52.649852238s) [seg_pos={0 0}, upload=32277]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:21:58.218936371 (30h55m52.650016502s) [noise=true , address=104.36.82.23:4468 , piece_id=3KSAOQ5VZVSZJU22FRD5PPCCLEYE6LSAHZY6ABQHHSLLK7X3BUIQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BLgb3SqskvSobodWxH7Z4MXYh4GXLeEFLLhHC5A2VXEjoEqhg): protocol: context canceled; context canceled
Aug 10 00:21:58.219091066 (30h55m52.650171198s) [noise=true , address=104.36.82.46:4505 , piece_id=CB66O7U67QQJL5BGKHQ7SCPZFBWD2QDMMXBICJ3VZAVF5YAUM7VQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i6itGoBhLsLiqC8et8Y5L62fLjcWxy18u39NAr4R3nXNMWcsf): protocol: write tcp 188.166.225.170:60648->104.36.82.46:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:21:58.219178644 (30h55m52.650258765s) [noise=true , address=104.36.82.23:4473 , piece_id=75YWEBXLWWTUYMZOFRWCITIDXSBN2D3EDZWEMEK4VDV5NWC4SYBQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36398->104.36.82.23:4473: use of closed network connection
Aug 10 00:21:58.219184486 (30h55m52.650264617s) [noise=true , address=104.36.82.45:4911 , piece_id=JRTYRMBZACHQWTMABBYQLYX2XBMWOLI34WZQXCYGXLFQ6274QKZQ, seg_pos={0 0}, upload=32277]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mzM4hseStJYeWqqm29qGjdaKkxydqFsKaKwNFrywGpDWSwFDQ): protocol: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48214->104.36.82.45:4911: use of closed network connection
Aug 10 00:21:58.219218030 (30h55m52.650298161s) [seg_pos={0 0}, upload=32277]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:21:58.219303002 (30h55m52.650383133s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:21:58.219311638 (30h55m52.65039176s) [upload=32277]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:21:58.534962485 (30h55m52.966042616s) [upload=32277]: Done uploading segments...
Aug 10 00:21:58.534979979 (30h55m52.96606011s) [upload=32277]: Upload finished. err: <nil>
Duration: 8.202347626s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [................X..XX......X..........X.............X.......] duration:
10.255918382s
FAIL (2025-08-10 00:21:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:16:28.620752432 (30h50m23.051832564s) [upload=32188]: Starting upload Aug 10 00:16:28.620810554 (30h50m23.051890685s) [upload=32188]: Done starting upload Aug 10 00:16:28.620970289 (30h50m23.05205042s) [upload=32188]: Uploading segments... Aug 10 00:16:28.621164190 (30h50m23.052244331s) [upload=32188]: Got next segment. Inline: false Aug 10 00:16:28.621214567 (30h50m23.052294698s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:16:28.621220468 (30h50m23.052300609s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:16:28.833002471 (30h50m23.264082602s) [upload=32188]: Next segment err: metaclient: Too Many Requests Aug 10 00:16:28.833020365 (30h50m23.264100486s) [upload=32188]: Done uploading segments...
Duration: 10.255949161s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.................X..XX......X..........X.............X......] duration:
9.480293574s
FAIL (2025-08-10 00:21:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:16:28.620752432 (30h50m23.051832564s) [upload=32188]: Starting upload Aug 10 00:16:28.620810554 (30h50m23.051890685s) [upload=32188]: Done starting upload Aug 10 00:16:28.620970289 (30h50m23.05205042s) [upload=32188]: Uploading segments... Aug 10 00:16:28.621164190 (30h50m23.052244331s) [upload=32188]: Got next segment. Inline: false Aug 10 00:16:28.621214567 (30h50m23.052294698s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:16:28.621220468 (30h50m23.052300609s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:16:28.833002471 (30h50m23.264082602s) [upload=32188]: Next segment err: metaclient: Too Many Requests Aug 10 00:16:28.833020365 (30h50m23.264100486s) [upload=32188]: Done uploading segments...
Duration: 9.480321569s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..................X..XX......X..........X.............X.....] duration:
6.880077663s
FAIL (2025-08-10 00:20:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:16:28.620752432 (30h50m23.051832564s) [upload=32188]: Starting upload Aug 10 00:16:28.620810554 (30h50m23.051890685s) [upload=32188]: Done starting upload Aug 10 00:16:28.620970289 (30h50m23.05205042s) [upload=32188]: Uploading segments... Aug 10 00:16:28.621164190 (30h50m23.052244331s) [upload=32188]: Got next segment. Inline: false Aug 10 00:16:28.621214567 (30h50m23.052294698s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:16:28.621220468 (30h50m23.052300609s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:16:28.833002471 (30h50m23.264082602s) [upload=32188]: Next segment err: metaclient: Too Many Requests Aug 10 00:16:28.833020365 (30h50m23.264100486s) [upload=32188]: Done uploading segments...
Duration: 6.880103331s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.............X...............X......X.........X...X.......X.] duration:
2.098191228s
FAIL (2025-08-10 00:20:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab0df287d5173e12923fd4bcb2ac1af1954b942c1f2b8c1f518babbc1daa4d3f != before 77903e616961380dd63f34728bf96c673069b77d680ad5c3e6fe262dfa40ac55 ======LOGS====== Aug 10 00:20:16.341232354 (30h54m10.772312475s) [upload=32251]: Starting upload Aug 10 00:20:16.341281188 (30h54m10.772361319s) [upload=32251]: Done starting upload Aug 10 00:20:16.341326124 (30h54m10.772406255s) [upload=32251]: Uploading segments... Aug 10 00:20:16.341357244 (30h54m10.772437375s) [upload=32251]: Got next segment. Inline: true Aug 10 00:20:16.341360831 (30h54m10.772440962s) [upload=32251]: Waiting for error group managing segments... Aug 10 00:20:16.341393773 (30h54m10.772473904s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:20:16.341397470 (30h54m10.772477601s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:20:16.341399945 (30h54m10.772480076s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:20:17.187110140 (30h54m11.618190311s) [upload=32251]: Done uploading segments... Aug 10 00:20:17.187130970 (30h54m11.618211101s) [upload=32251]: Upload finished. err: <nil>
Duration: 2.098216716s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..............X...............X......X.........X...X.......X] duration:
2.162988416s
FAIL (2025-08-10 00:20:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ab0df287d5173e12923fd4bcb2ac1af1954b942c1f2b8c1f518babbc1daa4d3f != before 77903e616961380dd63f34728bf96c673069b77d680ad5c3e6fe262dfa40ac55 ======LOGS====== Aug 10 00:20:16.341232354 (30h54m10.772312475s) [upload=32251]: Starting upload Aug 10 00:20:16.341281188 (30h54m10.772361319s) [upload=32251]: Done starting upload Aug 10 00:20:16.341326124 (30h54m10.772406255s) [upload=32251]: Uploading segments... Aug 10 00:20:16.341357244 (30h54m10.772437375s) [upload=32251]: Got next segment. Inline: true Aug 10 00:20:16.341360831 (30h54m10.772440962s) [upload=32251]: Waiting for error group managing segments... Aug 10 00:20:16.341393773 (30h54m10.772473904s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:20:16.341397470 (30h54m10.772477601s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:20:16.341399945 (30h54m10.772480076s) [upload=32251]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:20:17.187110140 (30h54m11.618190311s) [upload=32251]: Done uploading segments... Aug 10 00:20:17.187130970 (30h54m11.618211101s) [upload=32251]: Upload finished. err: <nil>
Duration: 2.163015777s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...............X...............X......X.........X...X.......] duration:
1.815522275s
FAIL (2025-08-10 00:19:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:15:39.296722506 (30h49m33.727802637s) [upload=32173]: Starting upload Aug 10 00:15:39.296766199 (30h49m33.72784633s) [upload=32173]: Done starting upload Aug 10 00:15:39.296812518 (30h49m33.727892639s) [upload=32173]: Uploading segments... Aug 10 00:15:39.296844318 (30h49m33.727924449s) [upload=32173]: Got next segment. Inline: true Aug 10 00:15:39.296848176 (30h49m33.727928307s) [upload=32173]: Waiting for error group managing segments... Aug 10 00:15:39.296879876 (30h49m33.727960007s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:15:39.296883644 (30h49m33.727963775s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:15:39.296886129 (30h49m33.72796626s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:15:39.510062431 (30h49m33.941142562s) [upload=32173]: Done uploading segments... Aug 10 00:15:39.510078201 (30h49m33.941158332s) [upload=32173]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.815545409s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...................X..XX......X..........X.............X....] duration:
9.95727672s
FAIL (2025-08-10 00:19:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:16:28.620752432 (30h50m23.051832564s) [upload=32188]: Starting upload Aug 10 00:16:28.620810554 (30h50m23.051890685s) [upload=32188]: Done starting upload Aug 10 00:16:28.620970289 (30h50m23.05205042s) [upload=32188]: Uploading segments... Aug 10 00:16:28.621164190 (30h50m23.052244331s) [upload=32188]: Got next segment. Inline: false Aug 10 00:16:28.621214567 (30h50m23.052294698s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:16:28.621220468 (30h50m23.052300609s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:16:28.833002471 (30h50m23.264082602s) [upload=32188]: Next segment err: metaclient: Too Many Requests Aug 10 00:16:28.833020365 (30h50m23.264100486s) [upload=32188]: Done uploading segments...
Duration: 9.957306135s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....................X..XX......X..........X.............X...] duration:
7.887629032s
FAIL (2025-08-10 00:19:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:16:28.620752432 (30h50m23.051832564s) [upload=32188]: Starting upload Aug 10 00:16:28.620810554 (30h50m23.051890685s) [upload=32188]: Done starting upload Aug 10 00:16:28.620970289 (30h50m23.05205042s) [upload=32188]: Uploading segments... Aug 10 00:16:28.621164190 (30h50m23.052244331s) [upload=32188]: Got next segment. Inline: false Aug 10 00:16:28.621214567 (30h50m23.052294698s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:16:28.621220468 (30h50m23.052300609s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:16:28.833002471 (30h50m23.264082602s) [upload=32188]: Next segment err: metaclient: Too Many Requests Aug 10 00:16:28.833020365 (30h50m23.264100486s) [upload=32188]: Done uploading segments...
Duration: 7.887655391s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [................X...............X......X.........X...X......] duration:
1.809839381s
FAIL (2025-08-10 00:19:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:15:39.296722506 (30h49m33.727802637s) [upload=32173]: Starting upload Aug 10 00:15:39.296766199 (30h49m33.72784633s) [upload=32173]: Done starting upload Aug 10 00:15:39.296812518 (30h49m33.727892639s) [upload=32173]: Uploading segments... Aug 10 00:15:39.296844318 (30h49m33.727924449s) [upload=32173]: Got next segment. Inline: true Aug 10 00:15:39.296848176 (30h49m33.727928307s) [upload=32173]: Waiting for error group managing segments... Aug 10 00:15:39.296879876 (30h49m33.727960007s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:15:39.296883644 (30h49m33.727963775s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:15:39.296886129 (30h49m33.72796626s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:15:39.510062431 (30h49m33.941142562s) [upload=32173]: Done uploading segments... Aug 10 00:15:39.510078201 (30h49m33.941158332s) [upload=32173]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.809867236s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.................X...............X......X.........X...X.....] duration:
1.833180583s
FAIL (2025-08-10 00:18:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:15:39.296722506 (30h49m33.727802637s) [upload=32173]: Starting upload Aug 10 00:15:39.296766199 (30h49m33.72784633s) [upload=32173]: Done starting upload Aug 10 00:15:39.296812518 (30h49m33.727892639s) [upload=32173]: Uploading segments... Aug 10 00:15:39.296844318 (30h49m33.727924449s) [upload=32173]: Got next segment. Inline: true Aug 10 00:15:39.296848176 (30h49m33.727928307s) [upload=32173]: Waiting for error group managing segments... Aug 10 00:15:39.296879876 (30h49m33.727960007s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:15:39.296883644 (30h49m33.727963775s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:15:39.296886129 (30h49m33.72796626s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:15:39.510062431 (30h49m33.941142562s) [upload=32173]: Done uploading segments... Aug 10 00:15:39.510078201 (30h49m33.941158332s) [upload=32173]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.833208285s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....................X..XX......X..........X.............X..] duration:
10.345196443s
FAIL (2025-08-10 00:18:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:16:28.620752432 (30h50m23.051832564s) [upload=32188]: Starting upload Aug 10 00:16:28.620810554 (30h50m23.051890685s) [upload=32188]: Done starting upload Aug 10 00:16:28.620970289 (30h50m23.05205042s) [upload=32188]: Uploading segments... Aug 10 00:16:28.621164190 (30h50m23.052244331s) [upload=32188]: Got next segment. Inline: false Aug 10 00:16:28.621214567 (30h50m23.052294698s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:16:28.621220468 (30h50m23.052300609s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:16:28.833002471 (30h50m23.264082602s) [upload=32188]: Next segment err: metaclient: Too Many Requests Aug 10 00:16:28.833020365 (30h50m23.264100486s) [upload=32188]: Done uploading segments...
Duration: 10.345228082s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [X.................X...............X......X.........X...X....] duration:
1.88848218s
FAIL (2025-08-10 00:17:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:15:39.296722506 (30h49m33.727802637s) [upload=32173]: Starting upload Aug 10 00:15:39.296766199 (30h49m33.72784633s) [upload=32173]: Done starting upload Aug 10 00:15:39.296812518 (30h49m33.727892639s) [upload=32173]: Uploading segments... Aug 10 00:15:39.296844318 (30h49m33.727924449s) [upload=32173]: Got next segment. Inline: true Aug 10 00:15:39.296848176 (30h49m33.727928307s) [upload=32173]: Waiting for error group managing segments... Aug 10 00:15:39.296879876 (30h49m33.727960007s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:15:39.296883644 (30h49m33.727963775s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:15:39.296886129 (30h49m33.72796626s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:15:39.510062431 (30h49m33.941142562s) [upload=32173]: Done uploading segments... Aug 10 00:15:39.510078201 (30h49m33.941158332s) [upload=32173]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.888508822s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......................X..XX......X..........X.............X.] duration:
7.266222747s
FAIL (2025-08-10 00:17:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:16:28.620752432 (30h50m23.051832564s) [upload=32188]: Starting upload Aug 10 00:16:28.620810554 (30h50m23.051890685s) [upload=32188]: Done starting upload Aug 10 00:16:28.620970289 (30h50m23.05205042s) [upload=32188]: Uploading segments... Aug 10 00:16:28.621164190 (30h50m23.052244331s) [upload=32188]: Got next segment. Inline: false Aug 10 00:16:28.621214567 (30h50m23.052294698s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:16:28.621220468 (30h50m23.052300609s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:16:28.833002471 (30h50m23.264082602s) [upload=32188]: Next segment err: metaclient: Too Many Requests Aug 10 00:16:28.833020365 (30h50m23.264100486s) [upload=32188]: Done uploading segments...
Duration: 7.266257955s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X.................X...............X......X.........X...X...] duration:
1.834681312s
FAIL (2025-08-10 00:17:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:15:39.296722506 (30h49m33.727802637s) [upload=32173]: Starting upload Aug 10 00:15:39.296766199 (30h49m33.72784633s) [upload=32173]: Done starting upload Aug 10 00:15:39.296812518 (30h49m33.727892639s) [upload=32173]: Uploading segments... Aug 10 00:15:39.296844318 (30h49m33.727924449s) [upload=32173]: Got next segment. Inline: true Aug 10 00:15:39.296848176 (30h49m33.727928307s) [upload=32173]: Waiting for error group managing segments... Aug 10 00:15:39.296879876 (30h49m33.727960007s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:15:39.296883644 (30h49m33.727963775s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:15:39.296886129 (30h49m33.72796626s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:15:39.510062431 (30h49m33.941142562s) [upload=32173]: Done uploading segments... Aug 10 00:15:39.510078201 (30h49m33.941158332s) [upload=32173]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.834707092s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..X.................X...............X......X.........X...X..] duration:
1.870965437s
FAIL (2025-08-10 00:16:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:15:39.296722506 (30h49m33.727802637s) [upload=32173]: Starting upload Aug 10 00:15:39.296766199 (30h49m33.72784633s) [upload=32173]: Done starting upload Aug 10 00:15:39.296812518 (30h49m33.727892639s) [upload=32173]: Uploading segments... Aug 10 00:15:39.296844318 (30h49m33.727924449s) [upload=32173]: Got next segment. Inline: true Aug 10 00:15:39.296848176 (30h49m33.727928307s) [upload=32173]: Waiting for error group managing segments... Aug 10 00:15:39.296879876 (30h49m33.727960007s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:15:39.296883644 (30h49m33.727963775s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:15:39.296886129 (30h49m33.72796626s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:15:39.510062431 (30h49m33.941142562s) [upload=32173]: Done uploading segments... Aug 10 00:15:39.510078201 (30h49m33.941158332s) [upload=32173]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.871004231s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [X......................X..XX......X..........X.............X] duration:
853.692296ms
FAIL (2025-08-10 00:16:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:16:28.620752432 (30h50m23.051832564s) [upload=32188]: Starting upload Aug 10 00:16:28.620810554 (30h50m23.051890685s) [upload=32188]: Done starting upload Aug 10 00:16:28.620970289 (30h50m23.05205042s) [upload=32188]: Uploading segments... Aug 10 00:16:28.621164190 (30h50m23.052244331s) [upload=32188]: Got next segment. Inline: false Aug 10 00:16:28.621214567 (30h50m23.052294698s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:16:28.621220468 (30h50m23.052300609s) [upload=32188]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 00:16:28.833002471 (30h50m23.264082602s) [upload=32188]: Next segment err: metaclient: Too Many Requests Aug 10 00:16:28.833020365 (30h50m23.264100486s) [upload=32188]: Done uploading segments...
Duration: 853.713697ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [...X.................X...............X......X.........X...X.] duration:
1.879088017s
FAIL (2025-08-10 00:16:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:15:39.296722506 (30h49m33.727802637s) [upload=32173]: Starting upload Aug 10 00:15:39.296766199 (30h49m33.72784633s) [upload=32173]: Done starting upload Aug 10 00:15:39.296812518 (30h49m33.727892639s) [upload=32173]: Uploading segments... Aug 10 00:15:39.296844318 (30h49m33.727924449s) [upload=32173]: Got next segment. Inline: true Aug 10 00:15:39.296848176 (30h49m33.727928307s) [upload=32173]: Waiting for error group managing segments... Aug 10 00:15:39.296879876 (30h49m33.727960007s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:15:39.296883644 (30h49m33.727963775s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:15:39.296886129 (30h49m33.72796626s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:15:39.510062431 (30h49m33.941142562s) [upload=32173]: Done uploading segments... Aug 10 00:15:39.510078201 (30h49m33.941158332s) [upload=32173]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.879111471s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.X......................X..XX......X..........X.............] duration:
8.754708773s
FAIL (2025-08-10 00:16:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64a2f915505b18f712f2a7b40e134c2c64a5cba9a9febeb4992e9509ccc574b0 != before 1eabaa8d991416dbfa6c18580a99c4f6f2fe8efc7584293e8617f227bc7ed2c3
======LOGS======
Aug 10 00:06:40.129355904 (30h40m34.560436025s) [upload=32016]: Starting upload
Aug 10 00:06:40.129410488 (30h40m34.560490619s) [upload=32016]: Done starting upload
Aug 10 00:06:40.129495631 (30h40m34.560575762s) [upload=32016]: Uploading segments...
Aug 10 00:06:40.129621942 (30h40m34.560702083s) [upload=32016]: Got next segment. Inline: false
Aug 10 00:06:40.129663823 (30h40m34.560743954s) [upload=32016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:06:40.129670555 (30h40m34.560750696s) [upload=32016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:06:40.665884436 (30h40m35.096964567s) [seg_pos={0 0}, upload=32016]: Begin upload segment...
Aug 10 00:06:40.665944811 (30h40m35.097024942s) [seg_pos={0 0}, upload=32016]: Done begin upload segment.
Aug 10 00:06:40.665977484 (30h40m35.097057605s) [noise=true , address=104.36.82.19:4404 , piece_id=JKOFRLO3ZGGLWE55PT2TCXAKTJEHCQ5QO4W645NGE5TWXKNFB2TA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.665987001 (30h40m35.097067132s) [noise=true , address=104.36.82.35:4590 , piece_id=QEJ3A56SW4KKJJDKSY5HEDGOUD7LAXLT4WCTHL2GUBLLUNX6DNPQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666302736 (30h40m35.097382867s) [noise=true , address=104.36.82.38:4714 , piece_id=SPL7WG6Q6BELMFS6ES5FNSSOUEIX47GXL7TT6HQ3VVPDKBC42FEQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666413117 (30h40m35.097493248s) [noise=true , address=104.36.82.18:4365 , piece_id=O6PBYY2OQ267GM5ALG3BAOXNLH7EZ6GNF7J5TUZEHU6ELLUMAMCQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666572983 (30h40m35.097653114s) [noise=true , address=104.36.82.16:4312 , piece_id=DJQ72JKI67WMS66NKUY7X5HFDMT44L7Q7WKKVM3AL4HB2B3V6GQQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666706038 (30h40m35.097786169s) [noise=true , address=104.36.82.8:4999 , piece_id=LM6VGK7NSJ2FII3X6B75YZKF75RH47YLV2UN7FK4JQZKDE6T62JA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666782664 (30h40m35.097862795s) [noise=true , address=79.127.201.214:4296 , piece_id=TO3JVETXKUN45JZZ2EFRNDZBA54OIJCV4HYLA67DUBUDE2EPI4KA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666984681 (30h40m35.098064812s) [noise=true , address=104.36.82.62:4423 , piece_id=WV5VXRZWU2CBIM5TRV7FTOG3IYJYEL4KG3L2PTCN7RAQVYPX4WFQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667007435 (30h40m35.098087566s) [noise=true , address=104.36.82.59:4307 , piece_id=5AIUTJCCFCRHQBAEPDUB2IBJ4O6NIZ3EZKCAN3HW6PUDCZM26INQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667240420 (30h40m35.098320551s) [noise=true , address=104.36.82.23:4451 , piece_id=CR2SBOCAHSV7KG2N3QHRHBUAHLL7AZBTOK2KEJXQA7VTIUGFV6TQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667263755 (30h40m35.098343876s) [noise=true , address=104.36.82.60:4337 , piece_id=DEJU5XGN4APJVFD5WS2BN4E7S544P2L3BNC7BDMWM4FI6KTNKV3Q, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667479187 (30h40m35.098559318s) [noise=true , address=104.36.82.9:4037 , piece_id=X47CILSSQEJGO7U2KJLI43TFK6LWWDFETIP622GJEDSB3ET3TCQA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667686553 (30h40m35.098766684s) [noise=true , address=64.49.13.138:4488 , piece_id=XOPV4NABDFFI4CP3HC2ZQGTAEULZHF246PYPIPAL6DIITYJZWTPA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667895534 (30h40m35.098975665s) [noise=true , address=79.127.219.51:4196 , piece_id=YPUPWYWTGS7G2ZHZ5ZZPR7IC53XII3SOHDNAHLGECZXPCHP6F3PA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.668110325 (30h40m35.099190456s) [noise=true , address=104.36.82.52:4113 , piece_id=HWU4RQF73RPKU2QXLICUBRZ6UE6MGGHB5V3MLFYXU2BJAWBXQKAQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.668296681 (30h40m35.099376802s) [noise=true , address=104.36.82.44:4894 , piece_id=KCLJEBXRBETL22QOCUXADRHHN2QQ6LWYL567LGICQDZ52ZLPMVLA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.668516481 (30h40m35.099596602s) [noise=true , address=104.36.82.44:4895 , piece_id=HDFZSFWSKGSMJZAX5PASRIIC6JI3XYEXHJMMY7V76AO24JTWHZVA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.674342639 (30h40m35.10542277s) [noise=true , address=104.36.82.58:4290 , piece_id=R7TYCLOWJ34PMVRVPIKDBKYHL2ZKQBHNAYS4US36XM43MGDCMI2Q, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:41.820047126 (30h40m36.251127257s) [upload=32016]: Next returned nil segment
Aug 10 00:06:41.820065821 (30h40m36.251145952s) [upload=32016]: Waiting for error group managing segments...
Aug 10 00:06:42.113938414 (30h40m36.545018595s) [noise=true , address=64.49.13.138:4488 , piece_id=XOPV4NABDFFI4CP3HC2ZQGTAEULZHF246PYPIPAL6DIITYJZWTPA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.545995489 (30h40m36.97707561s) [noise=true , address=79.127.201.214:4296 , piece_id=TO3JVETXKUN45JZZ2EFRNDZBA54OIJCV4HYLA67DUBUDE2EPI4KA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.592255349 (30h40m37.02333548s) [noise=true , address=79.127.219.51:4196 , piece_id=YPUPWYWTGS7G2ZHZ5ZZPR7IC53XII3SOHDNAHLGECZXPCHP6F3PA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.638096317 (30h40m37.069176448s) [noise=true , address=104.36.82.9:4037 , piece_id=X47CILSSQEJGO7U2KJLI43TFK6LWWDFETIP622GJEDSB3ET3TCQA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.694220722 (30h40m37.125300853s) [noise=true , address=104.36.82.52:4113 , piece_id=HWU4RQF73RPKU2QXLICUBRZ6UE6MGGHB5V3MLFYXU2BJAWBXQKAQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.708873667 (30h40m37.139953798s) [noise=true , address=104.36.82.58:4290 , piece_id=R7TYCLOWJ34PMVRVPIKDBKYHL2ZKQBHNAYS4US36XM43MGDCMI2Q, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.759181903 (30h40m37.190262034s) [noise=true , address=104.36.82.16:4312 , piece_id=DJQ72JKI67WMS66NKUY7X5HFDMT44L7Q7WKKVM3AL4HB2B3V6GQQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.775128724 (30h40m37.206208856s) [noise=true , address=104.36.82.35:4590 , piece_id=QEJ3A56SW4KKJJDKSY5HEDGOUD7LAXLT4WCTHL2GUBLLUNX6DNPQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.863629605 (30h40m37.294709736s) [noise=true , address=104.36.82.8:4999 , piece_id=LM6VGK7NSJ2FII3X6B75YZKF75RH47YLV2UN7FK4JQZKDE6T62JA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.890287580 (30h40m37.321367711s) [noise=true , address=104.36.82.44:4895 , piece_id=HDFZSFWSKGSMJZAX5PASRIIC6JI3XYEXHJMMY7V76AO24JTWHZVA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:43.164792667 (30h40m37.595872808s) [noise=true , address=104.36.82.59:4307 , piece_id=5AIUTJCCFCRHQBAEPDUB2IBJ4O6NIZ3EZKCAN3HW6PUDCZM26INQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:43.599932479 (30h40m38.0310126s) [noise=true , address=104.36.82.38:4714 , piece_id=SPL7WG6Q6BELMFS6ES5FNSSOUEIX47GXL7TT6HQ3VVPDKBC42FEQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:43.696563906 (30h40m38.127644037s) [noise=true , address=104.36.82.18:4365 , piece_id=O6PBYY2OQ267GM5ALG3BAOXNLH7EZ6GNF7J5TUZEHU6ELLUMAMCQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:44.159071412 (30h40m38.590151543s) [noise=true , address=104.36.82.44:4894 , piece_id=KCLJEBXRBETL22QOCUXADRHHN2QQ6LWYL567LGICQDZ52ZLPMVLA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:44.159100668 (30h40m38.590180799s) [seg_pos={0 0}, upload=32016]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:06:44.159514730 (30h40m38.590594861s) [noise=true , address=104.36.82.62:4423 , piece_id=WV5VXRZWU2CBIM5TRV7FTOG3IYJYEL4KG3L2PTCN7RAQVYPX4WFQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: write tcp 188.166.225.170:42160->104.36.82.62:4423: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:06:44.159578473 (30h40m38.590658604s) [noise=true , address=104.36.82.60:4337 , piece_id=DEJU5XGN4APJVFD5WS2BN4E7S544P2L3BNC7BDMWM4FI6KTNKV3Q, seg_pos={0 0}, upload=32016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:55566->104.36.82.60:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:06:44.159655088 (30h40m38.590735229s) [noise=true , address=104.36.82.23:4451 , piece_id=CR2SBOCAHSV7KG2N3QHRHBUAHLL7AZBTOK2KEJXQA7VTIUGFV6TQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:06:44.159684415 (30h40m38.590764536s) [noise=true , address=104.36.82.19:4404 , piece_id=JKOFRLO3ZGGLWE55PT2TCXAKTJEHCQ5QO4W645NGE5TWXKNFB2TA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b): protocol: read tcp 188.166.225.170:57264->104.36.82.19:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:06:44.159698963 (30h40m38.590779094s) [seg_pos={0 0}, upload=32016]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:06:44.159802130 (30h40m38.590882261s) [upload=32016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:06:44.159806879 (30h40m38.59088701s) [upload=32016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:06:45.727797813 (30h40m40.158877944s) [upload=32016]: Done uploading segments...
Aug 10 00:06:45.727815137 (30h40m40.158895258s) [upload=32016]: Upload finished. err: <nil>
Duration: 8.754736916s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [....X.................X...............X......X.........X...X] duration:
857.100248ms
FAIL (2025-08-10 00:15:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 00:15:39.296722506 (30h49m33.727802637s) [upload=32173]: Starting upload Aug 10 00:15:39.296766199 (30h49m33.72784633s) [upload=32173]: Done starting upload Aug 10 00:15:39.296812518 (30h49m33.727892639s) [upload=32173]: Uploading segments... Aug 10 00:15:39.296844318 (30h49m33.727924449s) [upload=32173]: Got next segment. Inline: true Aug 10 00:15:39.296848176 (30h49m33.727928307s) [upload=32173]: Waiting for error group managing segments... Aug 10 00:15:39.296879876 (30h49m33.727960007s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:15:39.296883644 (30h49m33.727963775s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:15:39.296886129 (30h49m33.72796626s) [upload=32173]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:15:39.510062431 (30h49m33.941142562s) [upload=32173]: Done uploading segments... Aug 10 00:15:39.510078201 (30h49m33.941158332s) [upload=32173]: Upload finished. err: metaclient: Too Many Requests
Duration: 857.119636ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..X......................X..XX......X..........X............] duration:
9.253837923s
FAIL (2025-08-10 00:15:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 64a2f915505b18f712f2a7b40e134c2c64a5cba9a9febeb4992e9509ccc574b0 != before 1eabaa8d991416dbfa6c18580a99c4f6f2fe8efc7584293e8617f227bc7ed2c3
======LOGS======
Aug 10 00:06:40.129355904 (30h40m34.560436025s) [upload=32016]: Starting upload
Aug 10 00:06:40.129410488 (30h40m34.560490619s) [upload=32016]: Done starting upload
Aug 10 00:06:40.129495631 (30h40m34.560575762s) [upload=32016]: Uploading segments...
Aug 10 00:06:40.129621942 (30h40m34.560702083s) [upload=32016]: Got next segment. Inline: false
Aug 10 00:06:40.129663823 (30h40m34.560743954s) [upload=32016]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 00:06:40.129670555 (30h40m34.560750696s) [upload=32016]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 00:06:40.665884436 (30h40m35.096964567s) [seg_pos={0 0}, upload=32016]: Begin upload segment...
Aug 10 00:06:40.665944811 (30h40m35.097024942s) [seg_pos={0 0}, upload=32016]: Done begin upload segment.
Aug 10 00:06:40.665977484 (30h40m35.097057605s) [noise=true , address=104.36.82.19:4404 , piece_id=JKOFRLO3ZGGLWE55PT2TCXAKTJEHCQ5QO4W645NGE5TWXKNFB2TA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.665987001 (30h40m35.097067132s) [noise=true , address=104.36.82.35:4590 , piece_id=QEJ3A56SW4KKJJDKSY5HEDGOUD7LAXLT4WCTHL2GUBLLUNX6DNPQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666302736 (30h40m35.097382867s) [noise=true , address=104.36.82.38:4714 , piece_id=SPL7WG6Q6BELMFS6ES5FNSSOUEIX47GXL7TT6HQ3VVPDKBC42FEQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666413117 (30h40m35.097493248s) [noise=true , address=104.36.82.18:4365 , piece_id=O6PBYY2OQ267GM5ALG3BAOXNLH7EZ6GNF7J5TUZEHU6ELLUMAMCQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666572983 (30h40m35.097653114s) [noise=true , address=104.36.82.16:4312 , piece_id=DJQ72JKI67WMS66NKUY7X5HFDMT44L7Q7WKKVM3AL4HB2B3V6GQQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666706038 (30h40m35.097786169s) [noise=true , address=104.36.82.8:4999 , piece_id=LM6VGK7NSJ2FII3X6B75YZKF75RH47YLV2UN7FK4JQZKDE6T62JA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666782664 (30h40m35.097862795s) [noise=true , address=79.127.201.214:4296 , piece_id=TO3JVETXKUN45JZZ2EFRNDZBA54OIJCV4HYLA67DUBUDE2EPI4KA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.666984681 (30h40m35.098064812s) [noise=true , address=104.36.82.62:4423 , piece_id=WV5VXRZWU2CBIM5TRV7FTOG3IYJYEL4KG3L2PTCN7RAQVYPX4WFQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667007435 (30h40m35.098087566s) [noise=true , address=104.36.82.59:4307 , piece_id=5AIUTJCCFCRHQBAEPDUB2IBJ4O6NIZ3EZKCAN3HW6PUDCZM26INQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667240420 (30h40m35.098320551s) [noise=true , address=104.36.82.23:4451 , piece_id=CR2SBOCAHSV7KG2N3QHRHBUAHLL7AZBTOK2KEJXQA7VTIUGFV6TQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667263755 (30h40m35.098343876s) [noise=true , address=104.36.82.60:4337 , piece_id=DEJU5XGN4APJVFD5WS2BN4E7S544P2L3BNC7BDMWM4FI6KTNKV3Q, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667479187 (30h40m35.098559318s) [noise=true , address=104.36.82.9:4037 , piece_id=X47CILSSQEJGO7U2KJLI43TFK6LWWDFETIP622GJEDSB3ET3TCQA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667686553 (30h40m35.098766684s) [noise=true , address=64.49.13.138:4488 , piece_id=XOPV4NABDFFI4CP3HC2ZQGTAEULZHF246PYPIPAL6DIITYJZWTPA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.667895534 (30h40m35.098975665s) [noise=true , address=79.127.219.51:4196 , piece_id=YPUPWYWTGS7G2ZHZ5ZZPR7IC53XII3SOHDNAHLGECZXPCHP6F3PA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.668110325 (30h40m35.099190456s) [noise=true , address=104.36.82.52:4113 , piece_id=HWU4RQF73RPKU2QXLICUBRZ6UE6MGGHB5V3MLFYXU2BJAWBXQKAQ, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.668296681 (30h40m35.099376802s) [noise=true , address=104.36.82.44:4894 , piece_id=KCLJEBXRBETL22QOCUXADRHHN2QQ6LWYL567LGICQDZ52ZLPMVLA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.668516481 (30h40m35.099596602s) [noise=true , address=104.36.82.44:4895 , piece_id=HDFZSFWSKGSMJZAX5PASRIIC6JI3XYEXHJMMY7V76AO24JTWHZVA, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:40.674342639 (30h40m35.10542277s) [noise=true , address=104.36.82.58:4290 , piece_id=R7TYCLOWJ34PMVRVPIKDBKYHL2ZKQBHNAYS4US36XM43MGDCMI2Q, seg_pos={0 0}, upload=32016]: Uploading piece...
Aug 10 00:06:41.820047126 (30h40m36.251127257s) [upload=32016]: Next returned nil segment
Aug 10 00:06:41.820065821 (30h40m36.251145952s) [upload=32016]: Waiting for error group managing segments...
Aug 10 00:06:42.113938414 (30h40m36.545018595s) [noise=true , address=64.49.13.138:4488 , piece_id=XOPV4NABDFFI4CP3HC2ZQGTAEULZHF246PYPIPAL6DIITYJZWTPA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.545995489 (30h40m36.97707561s) [noise=true , address=79.127.201.214:4296 , piece_id=TO3JVETXKUN45JZZ2EFRNDZBA54OIJCV4HYLA67DUBUDE2EPI4KA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.592255349 (30h40m37.02333548s) [noise=true , address=79.127.219.51:4196 , piece_id=YPUPWYWTGS7G2ZHZ5ZZPR7IC53XII3SOHDNAHLGECZXPCHP6F3PA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.638096317 (30h40m37.069176448s) [noise=true , address=104.36.82.9:4037 , piece_id=X47CILSSQEJGO7U2KJLI43TFK6LWWDFETIP622GJEDSB3ET3TCQA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.694220722 (30h40m37.125300853s) [noise=true , address=104.36.82.52:4113 , piece_id=HWU4RQF73RPKU2QXLICUBRZ6UE6MGGHB5V3MLFYXU2BJAWBXQKAQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.708873667 (30h40m37.139953798s) [noise=true , address=104.36.82.58:4290 , piece_id=R7TYCLOWJ34PMVRVPIKDBKYHL2ZKQBHNAYS4US36XM43MGDCMI2Q, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.759181903 (30h40m37.190262034s) [noise=true , address=104.36.82.16:4312 , piece_id=DJQ72JKI67WMS66NKUY7X5HFDMT44L7Q7WKKVM3AL4HB2B3V6GQQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.775128724 (30h40m37.206208856s) [noise=true , address=104.36.82.35:4590 , piece_id=QEJ3A56SW4KKJJDKSY5HEDGOUD7LAXLT4WCTHL2GUBLLUNX6DNPQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.863629605 (30h40m37.294709736s) [noise=true , address=104.36.82.8:4999 , piece_id=LM6VGK7NSJ2FII3X6B75YZKF75RH47YLV2UN7FK4JQZKDE6T62JA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:42.890287580 (30h40m37.321367711s) [noise=true , address=104.36.82.44:4895 , piece_id=HDFZSFWSKGSMJZAX5PASRIIC6JI3XYEXHJMMY7V76AO24JTWHZVA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:43.164792667 (30h40m37.595872808s) [noise=true , address=104.36.82.59:4307 , piece_id=5AIUTJCCFCRHQBAEPDUB2IBJ4O6NIZ3EZKCAN3HW6PUDCZM26INQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:43.599932479 (30h40m38.0310126s) [noise=true , address=104.36.82.38:4714 , piece_id=SPL7WG6Q6BELMFS6ES5FNSSOUEIX47GXL7TT6HQ3VVPDKBC42FEQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:43.696563906 (30h40m38.127644037s) [noise=true , address=104.36.82.18:4365 , piece_id=O6PBYY2OQ267GM5ALG3BAOXNLH7EZ6GNF7J5TUZEHU6ELLUMAMCQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:44.159071412 (30h40m38.590151543s) [noise=true , address=104.36.82.44:4894 , piece_id=KCLJEBXRBETL22QOCUXADRHHN2QQ6LWYL567LGICQDZ52ZLPMVLA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: <nil>
Aug 10 00:06:44.159100668 (30h40m38.590180799s) [seg_pos={0 0}, upload=32016]: Segment reached optimal threshold of 14 pieces.
Aug 10 00:06:44.159514730 (30h40m38.590594861s) [noise=true , address=104.36.82.62:4423 , piece_id=WV5VXRZWU2CBIM5TRV7FTOG3IYJYEL4KG3L2PTCN7RAQVYPX4WFQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12fUb7FPBapbEwdkCE7vsgwcbF5B8KGcDVZAtihDB9SDuvUpzA5): protocol: write tcp 188.166.225.170:42160->104.36.82.62:4423: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:06:44.159578473 (30h40m38.590658604s) [noise=true , address=104.36.82.60:4337 , piece_id=DEJU5XGN4APJVFD5WS2BN4E7S544P2L3BNC7BDMWM4FI6KTNKV3Q, seg_pos={0 0}, upload=32016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nTZFfzNCcVAjut7NXf9seifysJDfvXkS8aZSnXKfw6gh1TrjE): protocol: read tcp 188.166.225.170:55566->104.36.82.60:4337: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:06:44.159655088 (30h40m38.590735229s) [noise=true , address=104.36.82.23:4451 , piece_id=CR2SBOCAHSV7KG2N3QHRHBUAHLL7AZBTOK2KEJXQA7VTIUGFV6TQ, seg_pos={0 0}, upload=32016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bC4P3xBiPFkxLvavGFVbWKnbprCStL6UJgfKSA2Wd2fX7Mbfw): protocol: rpc: dial tcp 104.36.82.23:4451: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:06:44.159684415 (30h40m38.590764536s) [noise=true , address=104.36.82.19:4404 , piece_id=JKOFRLO3ZGGLWE55PT2TCXAKTJEHCQ5QO4W645NGE5TWXKNFB2TA, seg_pos={0 0}, upload=32016]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u1v9cAH2841Zq5JieXcPKWHYuEkg18S89ykFQuhtYBmvAPS7b): protocol: read tcp 188.166.225.170:57264->104.36.82.19:4404: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 10 00:06:44.159698963 (30h40m38.590779094s) [seg_pos={0 0}, upload=32016]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 00:06:44.159802130 (30h40m38.590882261s) [upload=32016]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 00:06:44.159806879 (30h40m38.59088701s) [upload=32016]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 00:06:45.727797813 (30h40m40.158877944s) [upload=32016]: Done uploading segments...
Aug 10 00:06:45.727815137 (30h40m40.158895258s) [upload=32016]: Upload finished. err: <nil>
Duration: 9.253863632s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X.................X...............X......X.........X...] duration:
1.834510175s
FAIL (2025-08-10 00:14:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 00:12:10.047505524 (30h46m4.478585655s) [upload=32112]: Starting upload Aug 10 00:12:10.047558075 (30h46m4.478638206s) [upload=32112]: Done starting upload Aug 10 00:12:10.047634912 (30h46m4.478715043s) [upload=32112]: Uploading segments... Aug 10 00:12:10.047664569 (30h46m4.4787447s) [upload=32112]: Got next segment. Inline: true Aug 10 00:12:10.047668556 (30h46m4.478748687s) [upload=32112]: Waiting for error group managing segments... Aug 10 00:12:10.047702322 (30h46m4.478782453s) [upload=32112]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 00:12:10.047706750 (30h46m4.478786881s) [upload=32112]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 00:12:10.047709335 (30h46m4.478789456s) [upload=32112]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 00:12:10.564350902 (30h46m4.995431053s) [upload=32112]: Done uploading segments... Aug 10 00:12:10.564372333 (30h46m4.995452464s) [upload=32112]: Upload finished. err: <nil>
Duration: 1.834541224s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|