Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................X......................X....] duration:
1.864160815s
FAIL (2025-08-13 08:29:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:28:15.295614697 (111h2m9.726694818s) [upload=115557]: Starting upload Aug 13 08:28:15.295682237 (111h2m9.726762358s) [upload=115557]: Done starting upload Aug 13 08:28:15.295756409 (111h2m9.72683653s) [upload=115557]: Uploading segments... Aug 13 08:28:15.295865136 (111h2m9.726945267s) [upload=115557]: Got next segment. Inline: true Aug 13 08:28:15.295870347 (111h2m9.726950478s) [upload=115557]: Waiting for error group managing segments... Aug 13 08:28:15.295912016 (111h2m9.726992147s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:28:15.295916685 (111h2m9.726996816s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:28:15.295919510 (111h2m9.726999641s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:28:15.508435286 (111h2m9.939515417s) [upload=115557]: Done uploading segments... Aug 13 08:28:15.508449694 (111h2m9.939529825s) [upload=115557]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.864184692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................................X...................X...X..] duration:
5.653557624s
FAIL (2025-08-13 08:29:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 08:28:09.277138119 (111h2m3.70821824s) [upload=115552]: Starting upload
Aug 13 08:28:09.277199837 (111h2m3.708279968s) [upload=115552]: Done starting upload
Aug 13 08:28:09.277302454 (111h2m3.708382585s) [upload=115552]: Uploading segments...
Aug 13 08:28:09.277392786 (111h2m3.708472917s) [upload=115552]: Got next segment. Inline: false
Aug 13 08:28:09.277421211 (111h2m3.708501342s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 08:28:09.277428444 (111h2m3.708508565s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 08:28:10.391520513 (111h2m4.822600644s) [seg_pos={0 0}, upload=115552]: Begin upload segment...
Aug 13 08:28:10.391586559 (111h2m4.82266669s) [seg_pos={0 0}, upload=115552]: Done begin upload segment.
Aug 13 08:28:10.391608341 (111h2m4.822688472s) [noise=true , address=66.23.193.175:4557 , piece_id=2B2L5ICIICL4W22X33QYZY3HHIGCHIDZUSR5IQJ3WA4NTJTPEWQA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.391644430 (111h2m4.822724561s) [noise=true , address=77.90.31.13:4655 , piece_id=N7L6RWBNFLXT2BVW7HP5JWTTF22XWJEAI2VFB3SAHILOELZU666Q, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392032863 (111h2m4.823112984s) [noise=true , address=77.90.31.16:4757 , piece_id=2CBY2GKRDNTXGQD332TLUEJBIVDAWC4KLUXCHMZ5Y57MAGGS6NRA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392156951 (111h2m4.823237072s) [noise=true , address=104.36.82.8:4987 , piece_id=3PVT4FJKIV37YLWUKNN43KJORURGIPXLN4Y5YNOQEW7HWQZCDEVQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392308792 (111h2m4.823388923s) [noise=true , address=104.36.82.18:4381 , piece_id=2CP3LYKB2AM4KE57NL6HU5MGJS6TJRZLDRIQIM2YYZR77IQHMO2A, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392458959 (111h2m4.82353908s) [noise=true , address=104.36.82.59:4327 , piece_id=KXE345PISVS64LJ6TS7KXO7GRCT7VCLD2HNALMALY7IFLNYQOJQA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392653240 (111h2m4.823733371s) [noise=true , address=77.90.31.18:4820 , piece_id=IES7R65I6J7MHB3YN7HMZS3EQKG24ULZDYXMYBK6RWSKDZLXWKBA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392735858 (111h2m4.82381598s) [noise=true , address=104.36.82.34:4557 , piece_id=O2F7VEU4STCWHUAG65UHFAHGQOFU5S3IFYM2ZMX6HWLQDMLUJUXA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392956481 (111h2m4.824036612s) [noise=true , address=104.36.82.5:4860 , piece_id=7EGIYHKXODKGRIJIU3ATAVPPHL7ACKLSBFX4A3C2X7F34EJ6ZCQQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393004212 (111h2m4.824084343s) [noise=true , address=104.36.82.36:4648 , piece_id=ILUIK62XPA4CLXERFYRBQKP55SQY6SLAZCGLCXJO2TUQYXPJMKEA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393209615 (111h2m4.824289746s) [noise=true , address=77.90.31.17:4781 , piece_id=S7ITOGUUWR4F44E4ZMFR3J3LULNSI5PB7VC3BNZKDDATBLWDV5LQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393240824 (111h2m4.824320955s) [noise=true , address=104.36.82.23:4465 , piece_id=4JBNVW7Z6XAR7HVLBMPDXBS6COKU5YD5OF5P57QPXPTFWXNTAXGA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393436469 (111h2m4.824516591s) [noise=true , address=104.36.82.60:4338 , piece_id=R5E726SLE5QLT7ZDB7G7UCQTREUZNBZMIUUIPBATKKTFCEPKRKNA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393473781 (111h2m4.824553912s) [noise=true , address=104.36.82.39:4755 , piece_id=PHICHVUIPXAELRZHH2U7ERLD27XCFFWX5762M56Q3EILOBDRQE6Q, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393655948 (111h2m4.824736079s) [noise=true , address=77.90.31.21:4897 , piece_id=BRSOZY62Z7A2B2QPDUEZLUNKT4KN2IQOM6KAIVAQ2P2NT64W2MAA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393730251 (111h2m4.824810382s) [noise=true , address=66.23.193.175:4561 , piece_id=Q3DFXGTEST3ZAFEVKGH6A3FZG3IUASZERL5M7SWCCJWSTCLKAVSQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393962356 (111h2m4.825042487s) [noise=true , address=104.36.82.44:4884 , piece_id=IF7L6PWOHZSIJQT6BGOAXEHMDK6EWJSN6MN2QMODGZVRHXSM3NIQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.394168650 (111h2m4.825248781s) [noise=true , address=104.36.82.37:4683 , piece_id=627U6G2C5KWUMYLTMN4RY4HWJQ32JSBCBSUJ475YSFL2HVNNPOKA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:11.502320232 (111h2m5.933400363s) [upload=115552]: Next returned nil segment
Aug 13 08:28:11.502339058 (111h2m5.933419189s) [upload=115552]: Waiting for error group managing segments...
Aug 13 08:28:11.786106471 (111h2m6.217186602s) [noise=true , address=66.23.193.175:4557 , piece_id=2B2L5ICIICL4W22X33QYZY3HHIGCHIDZUSR5IQJ3WA4NTJTPEWQA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:11.883515699 (111h2m6.31459583s) [noise=true , address=66.23.193.175:4561 , piece_id=Q3DFXGTEST3ZAFEVKGH6A3FZG3IUASZERL5M7SWCCJWSTCLKAVSQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.359720331 (111h2m6.790800462s) [noise=true , address=77.90.31.13:4655 , piece_id=N7L6RWBNFLXT2BVW7HP5JWTTF22XWJEAI2VFB3SAHILOELZU666Q, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.365472877 (111h2m6.796553008s) [noise=true , address=77.90.31.16:4757 , piece_id=2CBY2GKRDNTXGQD332TLUEJBIVDAWC4KLUXCHMZ5Y57MAGGS6NRA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.365831333 (111h2m6.796911464s) [noise=true , address=104.36.82.60:4338 , piece_id=R5E726SLE5QLT7ZDB7G7UCQTREUZNBZMIUUIPBATKKTFCEPKRKNA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.368402914 (111h2m6.799483045s) [noise=true , address=104.36.82.8:4987 , piece_id=3PVT4FJKIV37YLWUKNN43KJORURGIPXLN4Y5YNOQEW7HWQZCDEVQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.370148323 (111h2m6.801228444s) [noise=true , address=104.36.82.18:4381 , piece_id=2CP3LYKB2AM4KE57NL6HU5MGJS6TJRZLDRIQIM2YYZR77IQHMO2A, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.386839108 (111h2m6.817919239s) [noise=true , address=104.36.82.5:4860 , piece_id=7EGIYHKXODKGRIJIU3ATAVPPHL7ACKLSBFX4A3C2X7F34EJ6ZCQQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.392409657 (111h2m6.823489788s) [noise=true , address=104.36.82.23:4465 , piece_id=4JBNVW7Z6XAR7HVLBMPDXBS6COKU5YD5OF5P57QPXPTFWXNTAXGA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.417956937 (111h2m6.849037068s) [noise=true , address=77.90.31.18:4820 , piece_id=IES7R65I6J7MHB3YN7HMZS3EQKG24ULZDYXMYBK6RWSKDZLXWKBA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.418402830 (111h2m6.849482991s) [noise=true , address=104.36.82.44:4884 , piece_id=IF7L6PWOHZSIJQT6BGOAXEHMDK6EWJSN6MN2QMODGZVRHXSM3NIQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.428567839 (111h2m6.85964797s) [noise=true , address=104.36.82.34:4557 , piece_id=O2F7VEU4STCWHUAG65UHFAHGQOFU5S3IFYM2ZMX6HWLQDMLUJUXA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.435834052 (111h2m6.866914183s) [noise=true , address=104.36.82.39:4755 , piece_id=PHICHVUIPXAELRZHH2U7ERLD27XCFFWX5762M56Q3EILOBDRQE6Q, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.436743112 (111h2m6.867823243s) [noise=true , address=104.36.82.36:4648 , piece_id=ILUIK62XPA4CLXERFYRBQKP55SQY6SLAZCGLCXJO2TUQYXPJMKEA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.436765064 (111h2m6.867845195s) [seg_pos={0 0}, upload=115552]: Segment reached optimal threshold of 14 pieces.
Aug 13 08:28:12.436856118 (111h2m6.867936239s) [noise=true , address=104.36.82.37:4683 , piece_id=627U6G2C5KWUMYLTMN4RY4HWJQ32JSBCBSUJ475YSFL2HVNNPOKA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1L5SArEdsoPVJwaaJnhe7vgmyTcWJgewcKE8GwDdUbudUgMCJh): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.436899911 (111h2m6.867980042s) [noise=true , address=104.36.82.59:4327 , piece_id=KXE345PISVS64LJ6TS7KXO7GRCT7VCLD2HNALMALY7IFLNYQOJQA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.436931592 (111h2m6.868011733s) [noise=true , address=77.90.31.17:4781 , piece_id=S7ITOGUUWR4F44E4ZMFR3J3LULNSI5PB7VC3BNZKDDATBLWDV5LQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.437004822 (111h2m6.868084953s) [noise=true , address=77.90.31.21:4897 , piece_id=BRSOZY62Z7A2B2QPDUEZLUNKT4KN2IQOM6KAIVAQ2P2NT64W2MAA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.437025411 (111h2m6.868105542s) [seg_pos={0 0}, upload=115552]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 08:28:12.437102619 (111h2m6.86818275s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 08:28:12.437106897 (111h2m6.868187028s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 08:28:12.736778421 (111h2m7.167858552s) [upload=115552]: Done uploading segments...
Aug 13 08:28:12.736792398 (111h2m7.167872519s) [upload=115552]: Upload finished. err: <nil>
Duration: 5.653577983s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................X......................X...] duration:
1.909125698s
FAIL (2025-08-13 08:29:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:28:15.295614697 (111h2m9.726694818s) [upload=115557]: Starting upload Aug 13 08:28:15.295682237 (111h2m9.726762358s) [upload=115557]: Done starting upload Aug 13 08:28:15.295756409 (111h2m9.72683653s) [upload=115557]: Uploading segments... Aug 13 08:28:15.295865136 (111h2m9.726945267s) [upload=115557]: Got next segment. Inline: true Aug 13 08:28:15.295870347 (111h2m9.726950478s) [upload=115557]: Waiting for error group managing segments... Aug 13 08:28:15.295912016 (111h2m9.726992147s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:28:15.295916685 (111h2m9.726996816s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:28:15.295919510 (111h2m9.726999641s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:28:15.508435286 (111h2m9.939515417s) [upload=115557]: Done uploading segments... Aug 13 08:28:15.508449694 (111h2m9.939529825s) [upload=115557]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.909161816s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................X......................X..] duration:
1.875047045s
FAIL (2025-08-13 08:29:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:28:15.295614697 (111h2m9.726694818s) [upload=115557]: Starting upload Aug 13 08:28:15.295682237 (111h2m9.726762358s) [upload=115557]: Done starting upload Aug 13 08:28:15.295756409 (111h2m9.72683653s) [upload=115557]: Uploading segments... Aug 13 08:28:15.295865136 (111h2m9.726945267s) [upload=115557]: Got next segment. Inline: true Aug 13 08:28:15.295870347 (111h2m9.726950478s) [upload=115557]: Waiting for error group managing segments... Aug 13 08:28:15.295912016 (111h2m9.726992147s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:28:15.295916685 (111h2m9.726996816s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:28:15.295919510 (111h2m9.726999641s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:28:15.508435286 (111h2m9.939515417s) [upload=115557]: Done uploading segments... Aug 13 08:28:15.508449694 (111h2m9.939529825s) [upload=115557]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.875068676s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................X...................X...X.] duration:
5.795426282s
FAIL (2025-08-13 08:28:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 08:28:09.277138119 (111h2m3.70821824s) [upload=115552]: Starting upload
Aug 13 08:28:09.277199837 (111h2m3.708279968s) [upload=115552]: Done starting upload
Aug 13 08:28:09.277302454 (111h2m3.708382585s) [upload=115552]: Uploading segments...
Aug 13 08:28:09.277392786 (111h2m3.708472917s) [upload=115552]: Got next segment. Inline: false
Aug 13 08:28:09.277421211 (111h2m3.708501342s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 08:28:09.277428444 (111h2m3.708508565s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 08:28:10.391520513 (111h2m4.822600644s) [seg_pos={0 0}, upload=115552]: Begin upload segment...
Aug 13 08:28:10.391586559 (111h2m4.82266669s) [seg_pos={0 0}, upload=115552]: Done begin upload segment.
Aug 13 08:28:10.391608341 (111h2m4.822688472s) [noise=true , address=66.23.193.175:4557 , piece_id=2B2L5ICIICL4W22X33QYZY3HHIGCHIDZUSR5IQJ3WA4NTJTPEWQA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.391644430 (111h2m4.822724561s) [noise=true , address=77.90.31.13:4655 , piece_id=N7L6RWBNFLXT2BVW7HP5JWTTF22XWJEAI2VFB3SAHILOELZU666Q, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392032863 (111h2m4.823112984s) [noise=true , address=77.90.31.16:4757 , piece_id=2CBY2GKRDNTXGQD332TLUEJBIVDAWC4KLUXCHMZ5Y57MAGGS6NRA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392156951 (111h2m4.823237072s) [noise=true , address=104.36.82.8:4987 , piece_id=3PVT4FJKIV37YLWUKNN43KJORURGIPXLN4Y5YNOQEW7HWQZCDEVQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392308792 (111h2m4.823388923s) [noise=true , address=104.36.82.18:4381 , piece_id=2CP3LYKB2AM4KE57NL6HU5MGJS6TJRZLDRIQIM2YYZR77IQHMO2A, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392458959 (111h2m4.82353908s) [noise=true , address=104.36.82.59:4327 , piece_id=KXE345PISVS64LJ6TS7KXO7GRCT7VCLD2HNALMALY7IFLNYQOJQA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392653240 (111h2m4.823733371s) [noise=true , address=77.90.31.18:4820 , piece_id=IES7R65I6J7MHB3YN7HMZS3EQKG24ULZDYXMYBK6RWSKDZLXWKBA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392735858 (111h2m4.82381598s) [noise=true , address=104.36.82.34:4557 , piece_id=O2F7VEU4STCWHUAG65UHFAHGQOFU5S3IFYM2ZMX6HWLQDMLUJUXA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392956481 (111h2m4.824036612s) [noise=true , address=104.36.82.5:4860 , piece_id=7EGIYHKXODKGRIJIU3ATAVPPHL7ACKLSBFX4A3C2X7F34EJ6ZCQQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393004212 (111h2m4.824084343s) [noise=true , address=104.36.82.36:4648 , piece_id=ILUIK62XPA4CLXERFYRBQKP55SQY6SLAZCGLCXJO2TUQYXPJMKEA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393209615 (111h2m4.824289746s) [noise=true , address=77.90.31.17:4781 , piece_id=S7ITOGUUWR4F44E4ZMFR3J3LULNSI5PB7VC3BNZKDDATBLWDV5LQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393240824 (111h2m4.824320955s) [noise=true , address=104.36.82.23:4465 , piece_id=4JBNVW7Z6XAR7HVLBMPDXBS6COKU5YD5OF5P57QPXPTFWXNTAXGA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393436469 (111h2m4.824516591s) [noise=true , address=104.36.82.60:4338 , piece_id=R5E726SLE5QLT7ZDB7G7UCQTREUZNBZMIUUIPBATKKTFCEPKRKNA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393473781 (111h2m4.824553912s) [noise=true , address=104.36.82.39:4755 , piece_id=PHICHVUIPXAELRZHH2U7ERLD27XCFFWX5762M56Q3EILOBDRQE6Q, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393655948 (111h2m4.824736079s) [noise=true , address=77.90.31.21:4897 , piece_id=BRSOZY62Z7A2B2QPDUEZLUNKT4KN2IQOM6KAIVAQ2P2NT64W2MAA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393730251 (111h2m4.824810382s) [noise=true , address=66.23.193.175:4561 , piece_id=Q3DFXGTEST3ZAFEVKGH6A3FZG3IUASZERL5M7SWCCJWSTCLKAVSQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393962356 (111h2m4.825042487s) [noise=true , address=104.36.82.44:4884 , piece_id=IF7L6PWOHZSIJQT6BGOAXEHMDK6EWJSN6MN2QMODGZVRHXSM3NIQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.394168650 (111h2m4.825248781s) [noise=true , address=104.36.82.37:4683 , piece_id=627U6G2C5KWUMYLTMN4RY4HWJQ32JSBCBSUJ475YSFL2HVNNPOKA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:11.502320232 (111h2m5.933400363s) [upload=115552]: Next returned nil segment
Aug 13 08:28:11.502339058 (111h2m5.933419189s) [upload=115552]: Waiting for error group managing segments...
Aug 13 08:28:11.786106471 (111h2m6.217186602s) [noise=true , address=66.23.193.175:4557 , piece_id=2B2L5ICIICL4W22X33QYZY3HHIGCHIDZUSR5IQJ3WA4NTJTPEWQA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:11.883515699 (111h2m6.31459583s) [noise=true , address=66.23.193.175:4561 , piece_id=Q3DFXGTEST3ZAFEVKGH6A3FZG3IUASZERL5M7SWCCJWSTCLKAVSQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.359720331 (111h2m6.790800462s) [noise=true , address=77.90.31.13:4655 , piece_id=N7L6RWBNFLXT2BVW7HP5JWTTF22XWJEAI2VFB3SAHILOELZU666Q, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.365472877 (111h2m6.796553008s) [noise=true , address=77.90.31.16:4757 , piece_id=2CBY2GKRDNTXGQD332TLUEJBIVDAWC4KLUXCHMZ5Y57MAGGS6NRA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.365831333 (111h2m6.796911464s) [noise=true , address=104.36.82.60:4338 , piece_id=R5E726SLE5QLT7ZDB7G7UCQTREUZNBZMIUUIPBATKKTFCEPKRKNA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.368402914 (111h2m6.799483045s) [noise=true , address=104.36.82.8:4987 , piece_id=3PVT4FJKIV37YLWUKNN43KJORURGIPXLN4Y5YNOQEW7HWQZCDEVQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.370148323 (111h2m6.801228444s) [noise=true , address=104.36.82.18:4381 , piece_id=2CP3LYKB2AM4KE57NL6HU5MGJS6TJRZLDRIQIM2YYZR77IQHMO2A, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.386839108 (111h2m6.817919239s) [noise=true , address=104.36.82.5:4860 , piece_id=7EGIYHKXODKGRIJIU3ATAVPPHL7ACKLSBFX4A3C2X7F34EJ6ZCQQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.392409657 (111h2m6.823489788s) [noise=true , address=104.36.82.23:4465 , piece_id=4JBNVW7Z6XAR7HVLBMPDXBS6COKU5YD5OF5P57QPXPTFWXNTAXGA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.417956937 (111h2m6.849037068s) [noise=true , address=77.90.31.18:4820 , piece_id=IES7R65I6J7MHB3YN7HMZS3EQKG24ULZDYXMYBK6RWSKDZLXWKBA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.418402830 (111h2m6.849482991s) [noise=true , address=104.36.82.44:4884 , piece_id=IF7L6PWOHZSIJQT6BGOAXEHMDK6EWJSN6MN2QMODGZVRHXSM3NIQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.428567839 (111h2m6.85964797s) [noise=true , address=104.36.82.34:4557 , piece_id=O2F7VEU4STCWHUAG65UHFAHGQOFU5S3IFYM2ZMX6HWLQDMLUJUXA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.435834052 (111h2m6.866914183s) [noise=true , address=104.36.82.39:4755 , piece_id=PHICHVUIPXAELRZHH2U7ERLD27XCFFWX5762M56Q3EILOBDRQE6Q, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.436743112 (111h2m6.867823243s) [noise=true , address=104.36.82.36:4648 , piece_id=ILUIK62XPA4CLXERFYRBQKP55SQY6SLAZCGLCXJO2TUQYXPJMKEA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.436765064 (111h2m6.867845195s) [seg_pos={0 0}, upload=115552]: Segment reached optimal threshold of 14 pieces.
Aug 13 08:28:12.436856118 (111h2m6.867936239s) [noise=true , address=104.36.82.37:4683 , piece_id=627U6G2C5KWUMYLTMN4RY4HWJQ32JSBCBSUJ475YSFL2HVNNPOKA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1L5SArEdsoPVJwaaJnhe7vgmyTcWJgewcKE8GwDdUbudUgMCJh): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.436899911 (111h2m6.867980042s) [noise=true , address=104.36.82.59:4327 , piece_id=KXE345PISVS64LJ6TS7KXO7GRCT7VCLD2HNALMALY7IFLNYQOJQA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.436931592 (111h2m6.868011733s) [noise=true , address=77.90.31.17:4781 , piece_id=S7ITOGUUWR4F44E4ZMFR3J3LULNSI5PB7VC3BNZKDDATBLWDV5LQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.437004822 (111h2m6.868084953s) [noise=true , address=77.90.31.21:4897 , piece_id=BRSOZY62Z7A2B2QPDUEZLUNKT4KN2IQOM6KAIVAQ2P2NT64W2MAA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.437025411 (111h2m6.868105542s) [seg_pos={0 0}, upload=115552]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 08:28:12.437102619 (111h2m6.86818275s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 08:28:12.437106897 (111h2m6.868187028s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 08:28:12.736778421 (111h2m7.167858552s) [upload=115552]: Done uploading segments...
Aug 13 08:28:12.736792398 (111h2m7.167872519s) [upload=115552]: Upload finished. err: <nil>
Duration: 5.795482019s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................X......................X.] duration:
2.010835553s
FAIL (2025-08-13 08:28:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:28:15.295614697 (111h2m9.726694818s) [upload=115557]: Starting upload Aug 13 08:28:15.295682237 (111h2m9.726762358s) [upload=115557]: Done starting upload Aug 13 08:28:15.295756409 (111h2m9.72683653s) [upload=115557]: Uploading segments... Aug 13 08:28:15.295865136 (111h2m9.726945267s) [upload=115557]: Got next segment. Inline: true Aug 13 08:28:15.295870347 (111h2m9.726950478s) [upload=115557]: Waiting for error group managing segments... Aug 13 08:28:15.295912016 (111h2m9.726992147s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:28:15.295916685 (111h2m9.726996816s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:28:15.295919510 (111h2m9.726999641s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:28:15.508435286 (111h2m9.939515417s) [upload=115557]: Done uploading segments... Aug 13 08:28:15.508449694 (111h2m9.939529825s) [upload=115557]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.010867024s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................X......................X] duration:
876.261347ms
FAIL (2025-08-13 08:28:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:28:15.295614697 (111h2m9.726694818s) [upload=115557]: Starting upload Aug 13 08:28:15.295682237 (111h2m9.726762358s) [upload=115557]: Done starting upload Aug 13 08:28:15.295756409 (111h2m9.72683653s) [upload=115557]: Uploading segments... Aug 13 08:28:15.295865136 (111h2m9.726945267s) [upload=115557]: Got next segment. Inline: true Aug 13 08:28:15.295870347 (111h2m9.726950478s) [upload=115557]: Waiting for error group managing segments... Aug 13 08:28:15.295912016 (111h2m9.726992147s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:28:15.295916685 (111h2m9.726996816s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:28:15.295919510 (111h2m9.726999641s) [upload=115557]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:28:15.508435286 (111h2m9.939515417s) [upload=115557]: Done uploading segments... Aug 13 08:28:15.508449694 (111h2m9.939529825s) [upload=115557]: Upload finished. err: metaclient: Too Many Requests
Duration: 876.275815ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................................X...................X...X] duration:
4.76182823s
FAIL (2025-08-13 08:28:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 13 08:28:09.277138119 (111h2m3.70821824s) [upload=115552]: Starting upload
Aug 13 08:28:09.277199837 (111h2m3.708279968s) [upload=115552]: Done starting upload
Aug 13 08:28:09.277302454 (111h2m3.708382585s) [upload=115552]: Uploading segments...
Aug 13 08:28:09.277392786 (111h2m3.708472917s) [upload=115552]: Got next segment. Inline: false
Aug 13 08:28:09.277421211 (111h2m3.708501342s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 08:28:09.277428444 (111h2m3.708508565s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 08:28:10.391520513 (111h2m4.822600644s) [seg_pos={0 0}, upload=115552]: Begin upload segment...
Aug 13 08:28:10.391586559 (111h2m4.82266669s) [seg_pos={0 0}, upload=115552]: Done begin upload segment.
Aug 13 08:28:10.391608341 (111h2m4.822688472s) [noise=true , address=66.23.193.175:4557 , piece_id=2B2L5ICIICL4W22X33QYZY3HHIGCHIDZUSR5IQJ3WA4NTJTPEWQA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.391644430 (111h2m4.822724561s) [noise=true , address=77.90.31.13:4655 , piece_id=N7L6RWBNFLXT2BVW7HP5JWTTF22XWJEAI2VFB3SAHILOELZU666Q, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392032863 (111h2m4.823112984s) [noise=true , address=77.90.31.16:4757 , piece_id=2CBY2GKRDNTXGQD332TLUEJBIVDAWC4KLUXCHMZ5Y57MAGGS6NRA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392156951 (111h2m4.823237072s) [noise=true , address=104.36.82.8:4987 , piece_id=3PVT4FJKIV37YLWUKNN43KJORURGIPXLN4Y5YNOQEW7HWQZCDEVQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392308792 (111h2m4.823388923s) [noise=true , address=104.36.82.18:4381 , piece_id=2CP3LYKB2AM4KE57NL6HU5MGJS6TJRZLDRIQIM2YYZR77IQHMO2A, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392458959 (111h2m4.82353908s) [noise=true , address=104.36.82.59:4327 , piece_id=KXE345PISVS64LJ6TS7KXO7GRCT7VCLD2HNALMALY7IFLNYQOJQA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392653240 (111h2m4.823733371s) [noise=true , address=77.90.31.18:4820 , piece_id=IES7R65I6J7MHB3YN7HMZS3EQKG24ULZDYXMYBK6RWSKDZLXWKBA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392735858 (111h2m4.82381598s) [noise=true , address=104.36.82.34:4557 , piece_id=O2F7VEU4STCWHUAG65UHFAHGQOFU5S3IFYM2ZMX6HWLQDMLUJUXA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.392956481 (111h2m4.824036612s) [noise=true , address=104.36.82.5:4860 , piece_id=7EGIYHKXODKGRIJIU3ATAVPPHL7ACKLSBFX4A3C2X7F34EJ6ZCQQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393004212 (111h2m4.824084343s) [noise=true , address=104.36.82.36:4648 , piece_id=ILUIK62XPA4CLXERFYRBQKP55SQY6SLAZCGLCXJO2TUQYXPJMKEA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393209615 (111h2m4.824289746s) [noise=true , address=77.90.31.17:4781 , piece_id=S7ITOGUUWR4F44E4ZMFR3J3LULNSI5PB7VC3BNZKDDATBLWDV5LQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393240824 (111h2m4.824320955s) [noise=true , address=104.36.82.23:4465 , piece_id=4JBNVW7Z6XAR7HVLBMPDXBS6COKU5YD5OF5P57QPXPTFWXNTAXGA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393436469 (111h2m4.824516591s) [noise=true , address=104.36.82.60:4338 , piece_id=R5E726SLE5QLT7ZDB7G7UCQTREUZNBZMIUUIPBATKKTFCEPKRKNA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393473781 (111h2m4.824553912s) [noise=true , address=104.36.82.39:4755 , piece_id=PHICHVUIPXAELRZHH2U7ERLD27XCFFWX5762M56Q3EILOBDRQE6Q, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393655948 (111h2m4.824736079s) [noise=true , address=77.90.31.21:4897 , piece_id=BRSOZY62Z7A2B2QPDUEZLUNKT4KN2IQOM6KAIVAQ2P2NT64W2MAA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393730251 (111h2m4.824810382s) [noise=true , address=66.23.193.175:4561 , piece_id=Q3DFXGTEST3ZAFEVKGH6A3FZG3IUASZERL5M7SWCCJWSTCLKAVSQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.393962356 (111h2m4.825042487s) [noise=true , address=104.36.82.44:4884 , piece_id=IF7L6PWOHZSIJQT6BGOAXEHMDK6EWJSN6MN2QMODGZVRHXSM3NIQ, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:10.394168650 (111h2m4.825248781s) [noise=true , address=104.36.82.37:4683 , piece_id=627U6G2C5KWUMYLTMN4RY4HWJQ32JSBCBSUJ475YSFL2HVNNPOKA, seg_pos={0 0}, upload=115552]: Uploading piece...
Aug 13 08:28:11.502320232 (111h2m5.933400363s) [upload=115552]: Next returned nil segment
Aug 13 08:28:11.502339058 (111h2m5.933419189s) [upload=115552]: Waiting for error group managing segments...
Aug 13 08:28:11.786106471 (111h2m6.217186602s) [noise=true , address=66.23.193.175:4557 , piece_id=2B2L5ICIICL4W22X33QYZY3HHIGCHIDZUSR5IQJ3WA4NTJTPEWQA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:11.883515699 (111h2m6.31459583s) [noise=true , address=66.23.193.175:4561 , piece_id=Q3DFXGTEST3ZAFEVKGH6A3FZG3IUASZERL5M7SWCCJWSTCLKAVSQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.359720331 (111h2m6.790800462s) [noise=true , address=77.90.31.13:4655 , piece_id=N7L6RWBNFLXT2BVW7HP5JWTTF22XWJEAI2VFB3SAHILOELZU666Q, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.365472877 (111h2m6.796553008s) [noise=true , address=77.90.31.16:4757 , piece_id=2CBY2GKRDNTXGQD332TLUEJBIVDAWC4KLUXCHMZ5Y57MAGGS6NRA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.365831333 (111h2m6.796911464s) [noise=true , address=104.36.82.60:4338 , piece_id=R5E726SLE5QLT7ZDB7G7UCQTREUZNBZMIUUIPBATKKTFCEPKRKNA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.368402914 (111h2m6.799483045s) [noise=true , address=104.36.82.8:4987 , piece_id=3PVT4FJKIV37YLWUKNN43KJORURGIPXLN4Y5YNOQEW7HWQZCDEVQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.370148323 (111h2m6.801228444s) [noise=true , address=104.36.82.18:4381 , piece_id=2CP3LYKB2AM4KE57NL6HU5MGJS6TJRZLDRIQIM2YYZR77IQHMO2A, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.386839108 (111h2m6.817919239s) [noise=true , address=104.36.82.5:4860 , piece_id=7EGIYHKXODKGRIJIU3ATAVPPHL7ACKLSBFX4A3C2X7F34EJ6ZCQQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.392409657 (111h2m6.823489788s) [noise=true , address=104.36.82.23:4465 , piece_id=4JBNVW7Z6XAR7HVLBMPDXBS6COKU5YD5OF5P57QPXPTFWXNTAXGA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.417956937 (111h2m6.849037068s) [noise=true , address=77.90.31.18:4820 , piece_id=IES7R65I6J7MHB3YN7HMZS3EQKG24ULZDYXMYBK6RWSKDZLXWKBA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.418402830 (111h2m6.849482991s) [noise=true , address=104.36.82.44:4884 , piece_id=IF7L6PWOHZSIJQT6BGOAXEHMDK6EWJSN6MN2QMODGZVRHXSM3NIQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.428567839 (111h2m6.85964797s) [noise=true , address=104.36.82.34:4557 , piece_id=O2F7VEU4STCWHUAG65UHFAHGQOFU5S3IFYM2ZMX6HWLQDMLUJUXA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.435834052 (111h2m6.866914183s) [noise=true , address=104.36.82.39:4755 , piece_id=PHICHVUIPXAELRZHH2U7ERLD27XCFFWX5762M56Q3EILOBDRQE6Q, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.436743112 (111h2m6.867823243s) [noise=true , address=104.36.82.36:4648 , piece_id=ILUIK62XPA4CLXERFYRBQKP55SQY6SLAZCGLCXJO2TUQYXPJMKEA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: <nil>
Aug 13 08:28:12.436765064 (111h2m6.867845195s) [seg_pos={0 0}, upload=115552]: Segment reached optimal threshold of 14 pieces.
Aug 13 08:28:12.436856118 (111h2m6.867936239s) [noise=true , address=104.36.82.37:4683 , piece_id=627U6G2C5KWUMYLTMN4RY4HWJQ32JSBCBSUJ475YSFL2HVNNPOKA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1L5SArEdsoPVJwaaJnhe7vgmyTcWJgewcKE8GwDdUbudUgMCJh): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.436899911 (111h2m6.867980042s) [noise=true , address=104.36.82.59:4327 , piece_id=KXE345PISVS64LJ6TS7KXO7GRCT7VCLD2HNALMALY7IFLNYQOJQA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1V4C6AWGbyYQWfinoSj7iKovHeTJ9hqypyC5U9rZ8pveXBBfCY): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.436931592 (111h2m6.868011733s) [noise=true , address=77.90.31.17:4781 , piece_id=S7ITOGUUWR4F44E4ZMFR3J3LULNSI5PB7VC3BNZKDDATBLWDV5LQ, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Uc2Hn41mUYgLtyirRtEGNv5iKBv8YqzQo3RYdoE4M1Fj29WgT): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.437004822 (111h2m6.868084953s) [noise=true , address=77.90.31.21:4897 , piece_id=BRSOZY62Z7A2B2QPDUEZLUNKT4KN2IQOM6KAIVAQ2P2NT64W2MAA, seg_pos={0 0}, upload=115552]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 13 08:28:12.437025411 (111h2m6.868105542s) [seg_pos={0 0}, upload=115552]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 08:28:12.437102619 (111h2m6.86818275s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 08:28:12.437106897 (111h2m6.868187028s) [upload=115552]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 08:28:12.736778421 (111h2m7.167858552s) [upload=115552]: Done uploading segments...
Aug 13 08:28:12.736792398 (111h2m7.167872519s) [upload=115552]: Upload finished. err: <nil>
Duration: 4.76185406s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X...................X...] duration:
5.74355095s
FAIL (2025-08-13 08:27:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2fcd3cce208473dec260c728cf21b922c9a1654c22d4a8b2d0f5d995b5d72a50 != before baa23ff41306fd4c05cf9bbdd3967fb05605d8aab8f6e6f03ced4f82b4694f00
======LOGS======
Aug 13 08:26:18.388204623 (111h0m12.819284754s) [upload=115521]: Starting upload
Aug 13 08:26:18.388252073 (111h0m12.819332205s) [upload=115521]: Done starting upload
Aug 13 08:26:18.388394306 (111h0m12.819474438s) [upload=115521]: Uploading segments...
Aug 13 08:26:18.388501612 (111h0m12.819581733s) [upload=115521]: Got next segment. Inline: false
Aug 13 08:26:18.388536739 (111h0m12.81961687s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 08:26:18.388541418 (111h0m12.819621539s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 08:26:18.855180878 (111h0m13.286261009s) [seg_pos={0 0}, upload=115521]: Begin upload segment...
Aug 13 08:26:18.855235452 (111h0m13.286315573s) [seg_pos={0 0}, upload=115521]: Done begin upload segment.
Aug 13 08:26:18.855262314 (111h0m13.286342445s) [noise=true , address=79.127.220.101:4071 , piece_id=LLC4D5PFN6X6AWGR25WJ6XNKVPKATQRG6N35TLJVUAWB6UPWSELQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855267594 (111h0m13.286347725s) [noise=true , address=104.36.82.37:4666 , piece_id=K52KEQZ7O5CQW7P3HIV2N3G7AYS36CPB7NS77CEBYITCBU5SP4QQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855483547 (111h0m13.286563678s) [noise=true , address=79.127.201.215:4359 , piece_id=AJMWGKS3IRUUEWCZNMFTTXRQFX4DYJFU3V3N3MJIWYESXTZQZLKQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855628093 (111h0m13.286708224s) [noise=true , address=104.36.82.4:4832 , piece_id=TNL2LVKNBQ4ZYQAFFGCQNMQTV5XPYTFXKL4URUM3JUK2H27ULXJA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855837304 (111h0m13.286917425s) [noise=true , address=104.36.82.36:4634 , piece_id=C4GDE3YHUGICKL5K2EI22JFYIZUBBQMTT2VDITGD7FR4VQLI26EA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855909312 (111h0m13.286989443s) [noise=true , address=77.90.31.18:4833 , piece_id=OL77XBKSH647O2IPMTX5ZCSQ42PAQRYMDEBWYVCZEE3WEDSL4ANA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856158689 (111h0m13.28723882s) [noise=true , address=77.90.31.21:4909 , piece_id=J455HSUDVCSHDVDZFVZC4SPWBJQ2IIVFC2T46VZBS6NGRJZG6ZGA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856202492 (111h0m13.287282623s) [noise=true , address=66.23.193.175:4554 , piece_id=GVKIPRQSU4P2UWVWQAV6VHZ3R5BXPAPB2ADTL7QYTDFIWWEXPH5A, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856428806 (111h0m13.287508937s) [noise=true , address=77.90.31.17:4776 , piece_id=I4OIPFIG3HGI757UNST66G7EJVZRMP2TKODWCL6MMG6VUFHGZGBA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856678353 (111h0m13.287758484s) [noise=true , address=79.127.219.38:4016 , piece_id=YOGQTWOBJAJPB63PARZ7P5ATWIULC7PHKCTQDYYE76ZDD6KXDLPQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856903945 (111h0m13.287984076s) [noise=true , address=77.90.31.11:4580 , piece_id=3SZLICF6YOKCQ7UG5WLMGZEZCGDYYGPFZ6A3AV33KK6Q4SYTFXOQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857124006 (111h0m13.288204137s) [noise=true , address=77.90.31.10:4526 , piece_id=DR7TD3UJ7XH3FBGZNVFPCNQXQPOURGLMGENJX6R3P53SDON53BGQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857347273 (111h0m13.288427394s) [noise=true , address=104.36.82.44:4899 , piece_id=3ERZ73G5T5E66S7JFCVW2JETGWB7BHP2BCUVIOF32CPYAYHI7FMA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857560461 (111h0m13.288640592s) [noise=true , address=104.36.82.38:4719 , piece_id=AL2JOCBXJ5DJJ6MUA4HL3PUROIVKMPIYH3YG5RT3S7NGUCFNT6AA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857758991 (111h0m13.288839122s) [noise=true , address=104.36.82.60:4355 , piece_id=XJTUNP2PUZTBCUJKDD66WVJQM52IET7ZAF6U7NMTBKISICBQTRXA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857981807 (111h0m13.289061938s) [noise=true , address=104.36.82.39:4754 , piece_id=CLMXLAYDYRWOKQBMQII3EFVXQWHW24D7PHZJI22GASXFKSTESPLQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.858228549 (111h0m13.28930868s) [noise=true , address=104.36.82.23:4445 , piece_id=H645KC7HEEO5LK6Z7QKOILEIRW3GWXR3MJ5JOHDTRYY4KTFJ7ZWQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.858433291 (111h0m13.289513422s) [noise=true , address=79.127.205.234:4598 , piece_id=4ZTBRSEDGLY2UZ3G7IYF53MKOVH7CAFTNVBICCLMIDR7QUEFBY2Q, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:20.018145926 (111h0m14.449226057s) [upload=115521]: Next returned nil segment
Aug 13 08:26:20.018161086 (111h0m14.449241217s) [upload=115521]: Waiting for error group managing segments...
Aug 13 08:26:20.312975887 (111h0m14.744056018s) [noise=true , address=79.127.205.234:4598 , piece_id=4ZTBRSEDGLY2UZ3G7IYF53MKOVH7CAFTNVBICCLMIDR7QUEFBY2Q, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.325422682 (111h0m14.756502813s) [noise=true , address=66.23.193.175:4554 , piece_id=GVKIPRQSU4P2UWVWQAV6VHZ3R5BXPAPB2ADTL7QYTDFIWWEXPH5A, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.703093064 (111h0m15.134173235s) [noise=true , address=79.127.220.101:4071 , piece_id=LLC4D5PFN6X6AWGR25WJ6XNKVPKATQRG6N35TLJVUAWB6UPWSELQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.788632159 (111h0m15.21971231s) [noise=true , address=77.90.31.18:4833 , piece_id=OL77XBKSH647O2IPMTX5ZCSQ42PAQRYMDEBWYVCZEE3WEDSL4ANA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.790066423 (111h0m15.221146564s) [noise=true , address=79.127.219.38:4016 , piece_id=YOGQTWOBJAJPB63PARZ7P5ATWIULC7PHKCTQDYYE76ZDD6KXDLPQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.791243665 (111h0m15.222323797s) [noise=true , address=77.90.31.17:4776 , piece_id=I4OIPFIG3HGI757UNST66G7EJVZRMP2TKODWCL6MMG6VUFHGZGBA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.801371975 (111h0m15.232452116s) [noise=true , address=77.90.31.10:4526 , piece_id=DR7TD3UJ7XH3FBGZNVFPCNQXQPOURGLMGENJX6R3P53SDON53BGQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.817084488 (111h0m15.248164619s) [noise=true , address=104.36.82.36:4634 , piece_id=C4GDE3YHUGICKL5K2EI22JFYIZUBBQMTT2VDITGD7FR4VQLI26EA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.820143881 (111h0m15.251224012s) [noise=true , address=77.90.31.11:4580 , piece_id=3SZLICF6YOKCQ7UG5WLMGZEZCGDYYGPFZ6A3AV33KK6Q4SYTFXOQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.831646239 (111h0m15.26272637s) [noise=true , address=104.36.82.38:4719 , piece_id=AL2JOCBXJ5DJJ6MUA4HL3PUROIVKMPIYH3YG5RT3S7NGUCFNT6AA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.834240193 (111h0m15.265320324s) [noise=true , address=104.36.82.37:4666 , piece_id=K52KEQZ7O5CQW7P3HIV2N3G7AYS36CPB7NS77CEBYITCBU5SP4QQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.840081148 (111h0m15.271161279s) [noise=true , address=79.127.201.215:4359 , piece_id=AJMWGKS3IRUUEWCZNMFTTXRQFX4DYJFU3V3N3MJIWYESXTZQZLKQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.842977991 (111h0m15.274058122s) [noise=true , address=104.36.82.39:4754 , piece_id=CLMXLAYDYRWOKQBMQII3EFVXQWHW24D7PHZJI22GASXFKSTESPLQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.897793703 (111h0m15.328873834s) [noise=true , address=104.36.82.4:4832 , piece_id=TNL2LVKNBQ4ZYQAFFGCQNMQTV5XPYTFXKL4URUM3JUK2H27ULXJA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.897883224 (111h0m15.328963355s) [seg_pos={0 0}, upload=115521]: Segment reached optimal threshold of 14 pieces.
Aug 13 08:26:20.898018232 (111h0m15.329098363s) [noise=true , address=104.36.82.23:4445 , piece_id=H645KC7HEEO5LK6Z7QKOILEIRW3GWXR3MJ5JOHDTRYY4KTFJ7ZWQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898032349 (111h0m15.32911248s) [noise=true , address=104.36.82.60:4355 , piece_id=XJTUNP2PUZTBCUJKDD66WVJQM52IET7ZAF6U7NMTBKISICBQTRXA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898093126 (111h0m15.329173247s) [noise=true , address=77.90.31.21:4909 , piece_id=J455HSUDVCSHDVDZFVZC4SPWBJQ2IIVFC2T46VZBS6NGRJZG6ZGA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898130427 (111h0m15.329210548s) [noise=true , address=104.36.82.44:4899 , piece_id=3ERZ73G5T5E66S7JFCVW2JETGWB7BHP2BCUVIOF32CPYAYHI7FMA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898142119 (111h0m15.32922225s) [seg_pos={0 0}, upload=115521]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 08:26:20.898205671 (111h0m15.329285792s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 08:26:20.898209969 (111h0m15.3292901s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 08:26:21.206906099 (111h0m15.63798623s) [upload=115521]: Done uploading segments...
Aug 13 08:26:21.206917211 (111h0m15.637997342s) [upload=115521]: Upload finished. err: <nil>
Duration: 5.743572572s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.866098653s
FAIL (2025-08-13 08:27:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 1.866123752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.906457251s
FAIL (2025-08-13 08:27:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 1.906489313s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X...................X..] duration:
5.715407327s
FAIL (2025-08-13 08:27:09 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2fcd3cce208473dec260c728cf21b922c9a1654c22d4a8b2d0f5d995b5d72a50 != before baa23ff41306fd4c05cf9bbdd3967fb05605d8aab8f6e6f03ced4f82b4694f00
======LOGS======
Aug 13 08:26:18.388204623 (111h0m12.819284754s) [upload=115521]: Starting upload
Aug 13 08:26:18.388252073 (111h0m12.819332205s) [upload=115521]: Done starting upload
Aug 13 08:26:18.388394306 (111h0m12.819474438s) [upload=115521]: Uploading segments...
Aug 13 08:26:18.388501612 (111h0m12.819581733s) [upload=115521]: Got next segment. Inline: false
Aug 13 08:26:18.388536739 (111h0m12.81961687s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 08:26:18.388541418 (111h0m12.819621539s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 08:26:18.855180878 (111h0m13.286261009s) [seg_pos={0 0}, upload=115521]: Begin upload segment...
Aug 13 08:26:18.855235452 (111h0m13.286315573s) [seg_pos={0 0}, upload=115521]: Done begin upload segment.
Aug 13 08:26:18.855262314 (111h0m13.286342445s) [noise=true , address=79.127.220.101:4071 , piece_id=LLC4D5PFN6X6AWGR25WJ6XNKVPKATQRG6N35TLJVUAWB6UPWSELQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855267594 (111h0m13.286347725s) [noise=true , address=104.36.82.37:4666 , piece_id=K52KEQZ7O5CQW7P3HIV2N3G7AYS36CPB7NS77CEBYITCBU5SP4QQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855483547 (111h0m13.286563678s) [noise=true , address=79.127.201.215:4359 , piece_id=AJMWGKS3IRUUEWCZNMFTTXRQFX4DYJFU3V3N3MJIWYESXTZQZLKQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855628093 (111h0m13.286708224s) [noise=true , address=104.36.82.4:4832 , piece_id=TNL2LVKNBQ4ZYQAFFGCQNMQTV5XPYTFXKL4URUM3JUK2H27ULXJA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855837304 (111h0m13.286917425s) [noise=true , address=104.36.82.36:4634 , piece_id=C4GDE3YHUGICKL5K2EI22JFYIZUBBQMTT2VDITGD7FR4VQLI26EA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855909312 (111h0m13.286989443s) [noise=true , address=77.90.31.18:4833 , piece_id=OL77XBKSH647O2IPMTX5ZCSQ42PAQRYMDEBWYVCZEE3WEDSL4ANA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856158689 (111h0m13.28723882s) [noise=true , address=77.90.31.21:4909 , piece_id=J455HSUDVCSHDVDZFVZC4SPWBJQ2IIVFC2T46VZBS6NGRJZG6ZGA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856202492 (111h0m13.287282623s) [noise=true , address=66.23.193.175:4554 , piece_id=GVKIPRQSU4P2UWVWQAV6VHZ3R5BXPAPB2ADTL7QYTDFIWWEXPH5A, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856428806 (111h0m13.287508937s) [noise=true , address=77.90.31.17:4776 , piece_id=I4OIPFIG3HGI757UNST66G7EJVZRMP2TKODWCL6MMG6VUFHGZGBA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856678353 (111h0m13.287758484s) [noise=true , address=79.127.219.38:4016 , piece_id=YOGQTWOBJAJPB63PARZ7P5ATWIULC7PHKCTQDYYE76ZDD6KXDLPQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856903945 (111h0m13.287984076s) [noise=true , address=77.90.31.11:4580 , piece_id=3SZLICF6YOKCQ7UG5WLMGZEZCGDYYGPFZ6A3AV33KK6Q4SYTFXOQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857124006 (111h0m13.288204137s) [noise=true , address=77.90.31.10:4526 , piece_id=DR7TD3UJ7XH3FBGZNVFPCNQXQPOURGLMGENJX6R3P53SDON53BGQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857347273 (111h0m13.288427394s) [noise=true , address=104.36.82.44:4899 , piece_id=3ERZ73G5T5E66S7JFCVW2JETGWB7BHP2BCUVIOF32CPYAYHI7FMA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857560461 (111h0m13.288640592s) [noise=true , address=104.36.82.38:4719 , piece_id=AL2JOCBXJ5DJJ6MUA4HL3PUROIVKMPIYH3YG5RT3S7NGUCFNT6AA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857758991 (111h0m13.288839122s) [noise=true , address=104.36.82.60:4355 , piece_id=XJTUNP2PUZTBCUJKDD66WVJQM52IET7ZAF6U7NMTBKISICBQTRXA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857981807 (111h0m13.289061938s) [noise=true , address=104.36.82.39:4754 , piece_id=CLMXLAYDYRWOKQBMQII3EFVXQWHW24D7PHZJI22GASXFKSTESPLQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.858228549 (111h0m13.28930868s) [noise=true , address=104.36.82.23:4445 , piece_id=H645KC7HEEO5LK6Z7QKOILEIRW3GWXR3MJ5JOHDTRYY4KTFJ7ZWQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.858433291 (111h0m13.289513422s) [noise=true , address=79.127.205.234:4598 , piece_id=4ZTBRSEDGLY2UZ3G7IYF53MKOVH7CAFTNVBICCLMIDR7QUEFBY2Q, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:20.018145926 (111h0m14.449226057s) [upload=115521]: Next returned nil segment
Aug 13 08:26:20.018161086 (111h0m14.449241217s) [upload=115521]: Waiting for error group managing segments...
Aug 13 08:26:20.312975887 (111h0m14.744056018s) [noise=true , address=79.127.205.234:4598 , piece_id=4ZTBRSEDGLY2UZ3G7IYF53MKOVH7CAFTNVBICCLMIDR7QUEFBY2Q, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.325422682 (111h0m14.756502813s) [noise=true , address=66.23.193.175:4554 , piece_id=GVKIPRQSU4P2UWVWQAV6VHZ3R5BXPAPB2ADTL7QYTDFIWWEXPH5A, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.703093064 (111h0m15.134173235s) [noise=true , address=79.127.220.101:4071 , piece_id=LLC4D5PFN6X6AWGR25WJ6XNKVPKATQRG6N35TLJVUAWB6UPWSELQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.788632159 (111h0m15.21971231s) [noise=true , address=77.90.31.18:4833 , piece_id=OL77XBKSH647O2IPMTX5ZCSQ42PAQRYMDEBWYVCZEE3WEDSL4ANA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.790066423 (111h0m15.221146564s) [noise=true , address=79.127.219.38:4016 , piece_id=YOGQTWOBJAJPB63PARZ7P5ATWIULC7PHKCTQDYYE76ZDD6KXDLPQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.791243665 (111h0m15.222323797s) [noise=true , address=77.90.31.17:4776 , piece_id=I4OIPFIG3HGI757UNST66G7EJVZRMP2TKODWCL6MMG6VUFHGZGBA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.801371975 (111h0m15.232452116s) [noise=true , address=77.90.31.10:4526 , piece_id=DR7TD3UJ7XH3FBGZNVFPCNQXQPOURGLMGENJX6R3P53SDON53BGQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.817084488 (111h0m15.248164619s) [noise=true , address=104.36.82.36:4634 , piece_id=C4GDE3YHUGICKL5K2EI22JFYIZUBBQMTT2VDITGD7FR4VQLI26EA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.820143881 (111h0m15.251224012s) [noise=true , address=77.90.31.11:4580 , piece_id=3SZLICF6YOKCQ7UG5WLMGZEZCGDYYGPFZ6A3AV33KK6Q4SYTFXOQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.831646239 (111h0m15.26272637s) [noise=true , address=104.36.82.38:4719 , piece_id=AL2JOCBXJ5DJJ6MUA4HL3PUROIVKMPIYH3YG5RT3S7NGUCFNT6AA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.834240193 (111h0m15.265320324s) [noise=true , address=104.36.82.37:4666 , piece_id=K52KEQZ7O5CQW7P3HIV2N3G7AYS36CPB7NS77CEBYITCBU5SP4QQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.840081148 (111h0m15.271161279s) [noise=true , address=79.127.201.215:4359 , piece_id=AJMWGKS3IRUUEWCZNMFTTXRQFX4DYJFU3V3N3MJIWYESXTZQZLKQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.842977991 (111h0m15.274058122s) [noise=true , address=104.36.82.39:4754 , piece_id=CLMXLAYDYRWOKQBMQII3EFVXQWHW24D7PHZJI22GASXFKSTESPLQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.897793703 (111h0m15.328873834s) [noise=true , address=104.36.82.4:4832 , piece_id=TNL2LVKNBQ4ZYQAFFGCQNMQTV5XPYTFXKL4URUM3JUK2H27ULXJA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.897883224 (111h0m15.328963355s) [seg_pos={0 0}, upload=115521]: Segment reached optimal threshold of 14 pieces.
Aug 13 08:26:20.898018232 (111h0m15.329098363s) [noise=true , address=104.36.82.23:4445 , piece_id=H645KC7HEEO5LK6Z7QKOILEIRW3GWXR3MJ5JOHDTRYY4KTFJ7ZWQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898032349 (111h0m15.32911248s) [noise=true , address=104.36.82.60:4355 , piece_id=XJTUNP2PUZTBCUJKDD66WVJQM52IET7ZAF6U7NMTBKISICBQTRXA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898093126 (111h0m15.329173247s) [noise=true , address=77.90.31.21:4909 , piece_id=J455HSUDVCSHDVDZFVZC4SPWBJQ2IIVFC2T46VZBS6NGRJZG6ZGA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898130427 (111h0m15.329210548s) [noise=true , address=104.36.82.44:4899 , piece_id=3ERZ73G5T5E66S7JFCVW2JETGWB7BHP2BCUVIOF32CPYAYHI7FMA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898142119 (111h0m15.32922225s) [seg_pos={0 0}, upload=115521]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 08:26:20.898205671 (111h0m15.329285792s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 08:26:20.898209969 (111h0m15.3292901s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 08:26:21.206906099 (111h0m15.63798623s) [upload=115521]: Done uploading segments...
Aug 13 08:26:21.206917211 (111h0m15.637997342s) [upload=115521]: Upload finished. err: <nil>
Duration: 5.715435069s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X...................X.] duration:
5.690341985s
FAIL (2025-08-13 08:26:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2fcd3cce208473dec260c728cf21b922c9a1654c22d4a8b2d0f5d995b5d72a50 != before baa23ff41306fd4c05cf9bbdd3967fb05605d8aab8f6e6f03ced4f82b4694f00
======LOGS======
Aug 13 08:26:18.388204623 (111h0m12.819284754s) [upload=115521]: Starting upload
Aug 13 08:26:18.388252073 (111h0m12.819332205s) [upload=115521]: Done starting upload
Aug 13 08:26:18.388394306 (111h0m12.819474438s) [upload=115521]: Uploading segments...
Aug 13 08:26:18.388501612 (111h0m12.819581733s) [upload=115521]: Got next segment. Inline: false
Aug 13 08:26:18.388536739 (111h0m12.81961687s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 08:26:18.388541418 (111h0m12.819621539s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 08:26:18.855180878 (111h0m13.286261009s) [seg_pos={0 0}, upload=115521]: Begin upload segment...
Aug 13 08:26:18.855235452 (111h0m13.286315573s) [seg_pos={0 0}, upload=115521]: Done begin upload segment.
Aug 13 08:26:18.855262314 (111h0m13.286342445s) [noise=true , address=79.127.220.101:4071 , piece_id=LLC4D5PFN6X6AWGR25WJ6XNKVPKATQRG6N35TLJVUAWB6UPWSELQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855267594 (111h0m13.286347725s) [noise=true , address=104.36.82.37:4666 , piece_id=K52KEQZ7O5CQW7P3HIV2N3G7AYS36CPB7NS77CEBYITCBU5SP4QQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855483547 (111h0m13.286563678s) [noise=true , address=79.127.201.215:4359 , piece_id=AJMWGKS3IRUUEWCZNMFTTXRQFX4DYJFU3V3N3MJIWYESXTZQZLKQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855628093 (111h0m13.286708224s) [noise=true , address=104.36.82.4:4832 , piece_id=TNL2LVKNBQ4ZYQAFFGCQNMQTV5XPYTFXKL4URUM3JUK2H27ULXJA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855837304 (111h0m13.286917425s) [noise=true , address=104.36.82.36:4634 , piece_id=C4GDE3YHUGICKL5K2EI22JFYIZUBBQMTT2VDITGD7FR4VQLI26EA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855909312 (111h0m13.286989443s) [noise=true , address=77.90.31.18:4833 , piece_id=OL77XBKSH647O2IPMTX5ZCSQ42PAQRYMDEBWYVCZEE3WEDSL4ANA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856158689 (111h0m13.28723882s) [noise=true , address=77.90.31.21:4909 , piece_id=J455HSUDVCSHDVDZFVZC4SPWBJQ2IIVFC2T46VZBS6NGRJZG6ZGA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856202492 (111h0m13.287282623s) [noise=true , address=66.23.193.175:4554 , piece_id=GVKIPRQSU4P2UWVWQAV6VHZ3R5BXPAPB2ADTL7QYTDFIWWEXPH5A, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856428806 (111h0m13.287508937s) [noise=true , address=77.90.31.17:4776 , piece_id=I4OIPFIG3HGI757UNST66G7EJVZRMP2TKODWCL6MMG6VUFHGZGBA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856678353 (111h0m13.287758484s) [noise=true , address=79.127.219.38:4016 , piece_id=YOGQTWOBJAJPB63PARZ7P5ATWIULC7PHKCTQDYYE76ZDD6KXDLPQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856903945 (111h0m13.287984076s) [noise=true , address=77.90.31.11:4580 , piece_id=3SZLICF6YOKCQ7UG5WLMGZEZCGDYYGPFZ6A3AV33KK6Q4SYTFXOQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857124006 (111h0m13.288204137s) [noise=true , address=77.90.31.10:4526 , piece_id=DR7TD3UJ7XH3FBGZNVFPCNQXQPOURGLMGENJX6R3P53SDON53BGQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857347273 (111h0m13.288427394s) [noise=true , address=104.36.82.44:4899 , piece_id=3ERZ73G5T5E66S7JFCVW2JETGWB7BHP2BCUVIOF32CPYAYHI7FMA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857560461 (111h0m13.288640592s) [noise=true , address=104.36.82.38:4719 , piece_id=AL2JOCBXJ5DJJ6MUA4HL3PUROIVKMPIYH3YG5RT3S7NGUCFNT6AA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857758991 (111h0m13.288839122s) [noise=true , address=104.36.82.60:4355 , piece_id=XJTUNP2PUZTBCUJKDD66WVJQM52IET7ZAF6U7NMTBKISICBQTRXA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857981807 (111h0m13.289061938s) [noise=true , address=104.36.82.39:4754 , piece_id=CLMXLAYDYRWOKQBMQII3EFVXQWHW24D7PHZJI22GASXFKSTESPLQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.858228549 (111h0m13.28930868s) [noise=true , address=104.36.82.23:4445 , piece_id=H645KC7HEEO5LK6Z7QKOILEIRW3GWXR3MJ5JOHDTRYY4KTFJ7ZWQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.858433291 (111h0m13.289513422s) [noise=true , address=79.127.205.234:4598 , piece_id=4ZTBRSEDGLY2UZ3G7IYF53MKOVH7CAFTNVBICCLMIDR7QUEFBY2Q, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:20.018145926 (111h0m14.449226057s) [upload=115521]: Next returned nil segment
Aug 13 08:26:20.018161086 (111h0m14.449241217s) [upload=115521]: Waiting for error group managing segments...
Aug 13 08:26:20.312975887 (111h0m14.744056018s) [noise=true , address=79.127.205.234:4598 , piece_id=4ZTBRSEDGLY2UZ3G7IYF53MKOVH7CAFTNVBICCLMIDR7QUEFBY2Q, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.325422682 (111h0m14.756502813s) [noise=true , address=66.23.193.175:4554 , piece_id=GVKIPRQSU4P2UWVWQAV6VHZ3R5BXPAPB2ADTL7QYTDFIWWEXPH5A, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.703093064 (111h0m15.134173235s) [noise=true , address=79.127.220.101:4071 , piece_id=LLC4D5PFN6X6AWGR25WJ6XNKVPKATQRG6N35TLJVUAWB6UPWSELQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.788632159 (111h0m15.21971231s) [noise=true , address=77.90.31.18:4833 , piece_id=OL77XBKSH647O2IPMTX5ZCSQ42PAQRYMDEBWYVCZEE3WEDSL4ANA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.790066423 (111h0m15.221146564s) [noise=true , address=79.127.219.38:4016 , piece_id=YOGQTWOBJAJPB63PARZ7P5ATWIULC7PHKCTQDYYE76ZDD6KXDLPQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.791243665 (111h0m15.222323797s) [noise=true , address=77.90.31.17:4776 , piece_id=I4OIPFIG3HGI757UNST66G7EJVZRMP2TKODWCL6MMG6VUFHGZGBA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.801371975 (111h0m15.232452116s) [noise=true , address=77.90.31.10:4526 , piece_id=DR7TD3UJ7XH3FBGZNVFPCNQXQPOURGLMGENJX6R3P53SDON53BGQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.817084488 (111h0m15.248164619s) [noise=true , address=104.36.82.36:4634 , piece_id=C4GDE3YHUGICKL5K2EI22JFYIZUBBQMTT2VDITGD7FR4VQLI26EA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.820143881 (111h0m15.251224012s) [noise=true , address=77.90.31.11:4580 , piece_id=3SZLICF6YOKCQ7UG5WLMGZEZCGDYYGPFZ6A3AV33KK6Q4SYTFXOQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.831646239 (111h0m15.26272637s) [noise=true , address=104.36.82.38:4719 , piece_id=AL2JOCBXJ5DJJ6MUA4HL3PUROIVKMPIYH3YG5RT3S7NGUCFNT6AA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.834240193 (111h0m15.265320324s) [noise=true , address=104.36.82.37:4666 , piece_id=K52KEQZ7O5CQW7P3HIV2N3G7AYS36CPB7NS77CEBYITCBU5SP4QQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.840081148 (111h0m15.271161279s) [noise=true , address=79.127.201.215:4359 , piece_id=AJMWGKS3IRUUEWCZNMFTTXRQFX4DYJFU3V3N3MJIWYESXTZQZLKQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.842977991 (111h0m15.274058122s) [noise=true , address=104.36.82.39:4754 , piece_id=CLMXLAYDYRWOKQBMQII3EFVXQWHW24D7PHZJI22GASXFKSTESPLQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.897793703 (111h0m15.328873834s) [noise=true , address=104.36.82.4:4832 , piece_id=TNL2LVKNBQ4ZYQAFFGCQNMQTV5XPYTFXKL4URUM3JUK2H27ULXJA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.897883224 (111h0m15.328963355s) [seg_pos={0 0}, upload=115521]: Segment reached optimal threshold of 14 pieces.
Aug 13 08:26:20.898018232 (111h0m15.329098363s) [noise=true , address=104.36.82.23:4445 , piece_id=H645KC7HEEO5LK6Z7QKOILEIRW3GWXR3MJ5JOHDTRYY4KTFJ7ZWQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898032349 (111h0m15.32911248s) [noise=true , address=104.36.82.60:4355 , piece_id=XJTUNP2PUZTBCUJKDD66WVJQM52IET7ZAF6U7NMTBKISICBQTRXA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898093126 (111h0m15.329173247s) [noise=true , address=77.90.31.21:4909 , piece_id=J455HSUDVCSHDVDZFVZC4SPWBJQ2IIVFC2T46VZBS6NGRJZG6ZGA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898130427 (111h0m15.329210548s) [noise=true , address=104.36.82.44:4899 , piece_id=3ERZ73G5T5E66S7JFCVW2JETGWB7BHP2BCUVIOF32CPYAYHI7FMA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898142119 (111h0m15.32922225s) [seg_pos={0 0}, upload=115521]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 08:26:20.898205671 (111h0m15.329285792s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 08:26:20.898209969 (111h0m15.3292901s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 08:26:21.206906099 (111h0m15.63798623s) [upload=115521]: Done uploading segments...
Aug 13 08:26:21.206917211 (111h0m15.637997342s) [upload=115521]: Upload finished. err: <nil>
Duration: 5.690379137s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X...................X] duration:
5.701852781s
FAIL (2025-08-13 08:26:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2fcd3cce208473dec260c728cf21b922c9a1654c22d4a8b2d0f5d995b5d72a50 != before baa23ff41306fd4c05cf9bbdd3967fb05605d8aab8f6e6f03ced4f82b4694f00
======LOGS======
Aug 13 08:26:18.388204623 (111h0m12.819284754s) [upload=115521]: Starting upload
Aug 13 08:26:18.388252073 (111h0m12.819332205s) [upload=115521]: Done starting upload
Aug 13 08:26:18.388394306 (111h0m12.819474438s) [upload=115521]: Uploading segments...
Aug 13 08:26:18.388501612 (111h0m12.819581733s) [upload=115521]: Got next segment. Inline: false
Aug 13 08:26:18.388536739 (111h0m12.81961687s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 08:26:18.388541418 (111h0m12.819621539s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 08:26:18.855180878 (111h0m13.286261009s) [seg_pos={0 0}, upload=115521]: Begin upload segment...
Aug 13 08:26:18.855235452 (111h0m13.286315573s) [seg_pos={0 0}, upload=115521]: Done begin upload segment.
Aug 13 08:26:18.855262314 (111h0m13.286342445s) [noise=true , address=79.127.220.101:4071 , piece_id=LLC4D5PFN6X6AWGR25WJ6XNKVPKATQRG6N35TLJVUAWB6UPWSELQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855267594 (111h0m13.286347725s) [noise=true , address=104.36.82.37:4666 , piece_id=K52KEQZ7O5CQW7P3HIV2N3G7AYS36CPB7NS77CEBYITCBU5SP4QQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855483547 (111h0m13.286563678s) [noise=true , address=79.127.201.215:4359 , piece_id=AJMWGKS3IRUUEWCZNMFTTXRQFX4DYJFU3V3N3MJIWYESXTZQZLKQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855628093 (111h0m13.286708224s) [noise=true , address=104.36.82.4:4832 , piece_id=TNL2LVKNBQ4ZYQAFFGCQNMQTV5XPYTFXKL4URUM3JUK2H27ULXJA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855837304 (111h0m13.286917425s) [noise=true , address=104.36.82.36:4634 , piece_id=C4GDE3YHUGICKL5K2EI22JFYIZUBBQMTT2VDITGD7FR4VQLI26EA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.855909312 (111h0m13.286989443s) [noise=true , address=77.90.31.18:4833 , piece_id=OL77XBKSH647O2IPMTX5ZCSQ42PAQRYMDEBWYVCZEE3WEDSL4ANA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856158689 (111h0m13.28723882s) [noise=true , address=77.90.31.21:4909 , piece_id=J455HSUDVCSHDVDZFVZC4SPWBJQ2IIVFC2T46VZBS6NGRJZG6ZGA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856202492 (111h0m13.287282623s) [noise=true , address=66.23.193.175:4554 , piece_id=GVKIPRQSU4P2UWVWQAV6VHZ3R5BXPAPB2ADTL7QYTDFIWWEXPH5A, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856428806 (111h0m13.287508937s) [noise=true , address=77.90.31.17:4776 , piece_id=I4OIPFIG3HGI757UNST66G7EJVZRMP2TKODWCL6MMG6VUFHGZGBA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856678353 (111h0m13.287758484s) [noise=true , address=79.127.219.38:4016 , piece_id=YOGQTWOBJAJPB63PARZ7P5ATWIULC7PHKCTQDYYE76ZDD6KXDLPQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.856903945 (111h0m13.287984076s) [noise=true , address=77.90.31.11:4580 , piece_id=3SZLICF6YOKCQ7UG5WLMGZEZCGDYYGPFZ6A3AV33KK6Q4SYTFXOQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857124006 (111h0m13.288204137s) [noise=true , address=77.90.31.10:4526 , piece_id=DR7TD3UJ7XH3FBGZNVFPCNQXQPOURGLMGENJX6R3P53SDON53BGQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857347273 (111h0m13.288427394s) [noise=true , address=104.36.82.44:4899 , piece_id=3ERZ73G5T5E66S7JFCVW2JETGWB7BHP2BCUVIOF32CPYAYHI7FMA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857560461 (111h0m13.288640592s) [noise=true , address=104.36.82.38:4719 , piece_id=AL2JOCBXJ5DJJ6MUA4HL3PUROIVKMPIYH3YG5RT3S7NGUCFNT6AA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857758991 (111h0m13.288839122s) [noise=true , address=104.36.82.60:4355 , piece_id=XJTUNP2PUZTBCUJKDD66WVJQM52IET7ZAF6U7NMTBKISICBQTRXA, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.857981807 (111h0m13.289061938s) [noise=true , address=104.36.82.39:4754 , piece_id=CLMXLAYDYRWOKQBMQII3EFVXQWHW24D7PHZJI22GASXFKSTESPLQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.858228549 (111h0m13.28930868s) [noise=true , address=104.36.82.23:4445 , piece_id=H645KC7HEEO5LK6Z7QKOILEIRW3GWXR3MJ5JOHDTRYY4KTFJ7ZWQ, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:18.858433291 (111h0m13.289513422s) [noise=true , address=79.127.205.234:4598 , piece_id=4ZTBRSEDGLY2UZ3G7IYF53MKOVH7CAFTNVBICCLMIDR7QUEFBY2Q, seg_pos={0 0}, upload=115521]: Uploading piece...
Aug 13 08:26:20.018145926 (111h0m14.449226057s) [upload=115521]: Next returned nil segment
Aug 13 08:26:20.018161086 (111h0m14.449241217s) [upload=115521]: Waiting for error group managing segments...
Aug 13 08:26:20.312975887 (111h0m14.744056018s) [noise=true , address=79.127.205.234:4598 , piece_id=4ZTBRSEDGLY2UZ3G7IYF53MKOVH7CAFTNVBICCLMIDR7QUEFBY2Q, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.325422682 (111h0m14.756502813s) [noise=true , address=66.23.193.175:4554 , piece_id=GVKIPRQSU4P2UWVWQAV6VHZ3R5BXPAPB2ADTL7QYTDFIWWEXPH5A, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.703093064 (111h0m15.134173235s) [noise=true , address=79.127.220.101:4071 , piece_id=LLC4D5PFN6X6AWGR25WJ6XNKVPKATQRG6N35TLJVUAWB6UPWSELQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.788632159 (111h0m15.21971231s) [noise=true , address=77.90.31.18:4833 , piece_id=OL77XBKSH647O2IPMTX5ZCSQ42PAQRYMDEBWYVCZEE3WEDSL4ANA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.790066423 (111h0m15.221146564s) [noise=true , address=79.127.219.38:4016 , piece_id=YOGQTWOBJAJPB63PARZ7P5ATWIULC7PHKCTQDYYE76ZDD6KXDLPQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.791243665 (111h0m15.222323797s) [noise=true , address=77.90.31.17:4776 , piece_id=I4OIPFIG3HGI757UNST66G7EJVZRMP2TKODWCL6MMG6VUFHGZGBA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.801371975 (111h0m15.232452116s) [noise=true , address=77.90.31.10:4526 , piece_id=DR7TD3UJ7XH3FBGZNVFPCNQXQPOURGLMGENJX6R3P53SDON53BGQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.817084488 (111h0m15.248164619s) [noise=true , address=104.36.82.36:4634 , piece_id=C4GDE3YHUGICKL5K2EI22JFYIZUBBQMTT2VDITGD7FR4VQLI26EA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.820143881 (111h0m15.251224012s) [noise=true , address=77.90.31.11:4580 , piece_id=3SZLICF6YOKCQ7UG5WLMGZEZCGDYYGPFZ6A3AV33KK6Q4SYTFXOQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.831646239 (111h0m15.26272637s) [noise=true , address=104.36.82.38:4719 , piece_id=AL2JOCBXJ5DJJ6MUA4HL3PUROIVKMPIYH3YG5RT3S7NGUCFNT6AA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.834240193 (111h0m15.265320324s) [noise=true , address=104.36.82.37:4666 , piece_id=K52KEQZ7O5CQW7P3HIV2N3G7AYS36CPB7NS77CEBYITCBU5SP4QQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.840081148 (111h0m15.271161279s) [noise=true , address=79.127.201.215:4359 , piece_id=AJMWGKS3IRUUEWCZNMFTTXRQFX4DYJFU3V3N3MJIWYESXTZQZLKQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.842977991 (111h0m15.274058122s) [noise=true , address=104.36.82.39:4754 , piece_id=CLMXLAYDYRWOKQBMQII3EFVXQWHW24D7PHZJI22GASXFKSTESPLQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.897793703 (111h0m15.328873834s) [noise=true , address=104.36.82.4:4832 , piece_id=TNL2LVKNBQ4ZYQAFFGCQNMQTV5XPYTFXKL4URUM3JUK2H27ULXJA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: <nil>
Aug 13 08:26:20.897883224 (111h0m15.328963355s) [seg_pos={0 0}, upload=115521]: Segment reached optimal threshold of 14 pieces.
Aug 13 08:26:20.898018232 (111h0m15.329098363s) [noise=true , address=104.36.82.23:4445 , piece_id=H645KC7HEEO5LK6Z7QKOILEIRW3GWXR3MJ5JOHDTRYY4KTFJ7ZWQ, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898032349 (111h0m15.32911248s) [noise=true , address=104.36.82.60:4355 , piece_id=XJTUNP2PUZTBCUJKDD66WVJQM52IET7ZAF6U7NMTBKISICBQTRXA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898093126 (111h0m15.329173247s) [noise=true , address=77.90.31.21:4909 , piece_id=J455HSUDVCSHDVDZFVZC4SPWBJQ2IIVFC2T46VZBS6NGRJZG6ZGA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121RT7tP6czMFAiZ3DjzSSsYgPt3xZXVbXVpkcYxaZYscNiMjL6): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898130427 (111h0m15.329210548s) [noise=true , address=104.36.82.44:4899 , piece_id=3ERZ73G5T5E66S7JFCVW2JETGWB7BHP2BCUVIOF32CPYAYHI7FMA, seg_pos={0 0}, upload=115521]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b4pZVQRnjcQNn45VTgdsz5fpjYPMAzSXGR5KJ5BP9XHMkRnRw): protocol: expected piece hash; context canceled; EOF
Aug 13 08:26:20.898142119 (111h0m15.32922225s) [seg_pos={0 0}, upload=115521]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 08:26:20.898205671 (111h0m15.329285792s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 08:26:20.898209969 (111h0m15.3292901s) [upload=115521]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 08:26:21.206906099 (111h0m15.63798623s) [upload=115521]: Done uploading segments...
Aug 13 08:26:21.206917211 (111h0m15.637997342s) [upload=115521]: Upload finished. err: <nil>
Duration: 5.701881906s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.87391727s
FAIL (2025-08-13 08:26:09 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 1.873942658s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.90566986s
FAIL (2025-08-13 08:25:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.905699597s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.049794214s
FAIL (2025-08-13 08:25:17 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 2.049820616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
6.044320827s
FAIL (2025-08-13 08:25:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.044348158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.965571892s
FAIL (2025-08-13 08:24:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.965589856s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.861374134s
FAIL (2025-08-13 08:24:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 1.861399893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
11.250755094s
FAIL (2025-08-13 08:23:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 11.250776946s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.624719782s
FAIL (2025-08-13 08:23:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 2.624748348s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.653274043s
FAIL (2025-08-13 08:22:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.653303549s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.846216652s
FAIL (2025-08-13 08:22:16 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 1.846241798s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X............................................X..............] duration:
5.744744493s
FAIL (2025-08-13 08:22:04 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.744774548s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X............................................X.............] duration:
5.811433431s
FAIL (2025-08-13 08:21:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.811460363s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
2.121435579s
FAIL (2025-08-13 08:21:17 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 2.121465407s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X............................................X............] duration:
5.865135896s
FAIL (2025-08-13 08:20:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.865159421s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
2.124861242s
FAIL (2025-08-13 08:20:21 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 2.12489667s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X............................................X...........] duration:
5.676109968s
FAIL (2025-08-13 08:20:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.67613695s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X.............................................X.............] duration:
1.900762169s
FAIL (2025-08-13 08:19:47 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 1.900787117s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X............................................X..........] duration:
6.015115815s
FAIL (2025-08-13 08:19:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.01514425s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X.............................................X............] duration:
1.841045006s
FAIL (2025-08-13 08:19:09 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 1.841074183s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X............................................X.........] duration:
5.644496586s
FAIL (2025-08-13 08:18:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.644523338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X.............................................X...........] duration:
2.269131903s
FAIL (2025-08-13 08:18:12 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 2.26915129s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.....X............................................X........] duration:
5.97493171s
FAIL (2025-08-13 08:18:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.974959574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.....X............................................X.......] duration:
5.77510795s
FAIL (2025-08-13 08:17:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.775135884s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X.............................................X..........] duration:
2.133259689s
FAIL (2025-08-13 08:17:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 2.133298463s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.....X............................................X......] duration:
5.89652068s
FAIL (2025-08-13 08:16:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.896556679s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X.............................................X.........] duration:
1.919143912s
FAIL (2025-08-13 08:16:25 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 1.919173218s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.....X............................................X.....] duration:
6.140896554s
FAIL (2025-08-13 08:16:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.140924517s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X.............................................X........] duration:
1.905550835s
FAIL (2025-08-13 08:16:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 1.905581534s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X.............................................X.......] duration:
2.149878954s
FAIL (2025-08-13 08:15:27 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 2.149909233s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X......X.............................................X......] duration:
3.098435704s
FAIL (2025-08-13 08:15:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 3.098483826s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.....X............................................X....] duration:
5.711417194s
FAIL (2025-08-13 08:14:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.711447011s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X......X.............................................X.....] duration:
2.090074478s
FAIL (2025-08-13 08:14:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 2.090098524s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X....X.....X............................................X...] duration:
5.854931233s
FAIL (2025-08-13 08:13:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.854957964s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X......X.............................................X....] duration:
1.99077674s
FAIL (2025-08-13 08:13:28 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 13 08:09:31.187356809 (110h43m25.61843694s) [upload=115236]: Starting upload Aug 13 08:09:31.187404740 (110h43m25.618484871s) [upload=115236]: Done starting upload Aug 13 08:09:31.187492869 (110h43m25.618573s) [upload=115236]: Uploading segments... Aug 13 08:09:31.187575006 (110h43m25.618655137s) [upload=115236]: Got next segment. Inline: true Aug 13 08:09:31.187579555 (110h43m25.618659676s) [upload=115236]: Waiting for error group managing segments... Aug 13 08:09:31.187635181 (110h43m25.618715312s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:09:31.187639650 (110h43m25.618719781s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 08:09:31.187642605 (110h43m25.618722736s) [upload=115236]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 08:09:31.701413063 (110h43m26.132493194s) [upload=115236]: Done uploading segments... Aug 13 08:09:31.701429976 (110h43m26.132510107s) [upload=115236]: Upload finished. err: <nil>
Duration: 1.990804263s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X....X.....X............................................X..] duration:
5.969883325s
FAIL (2025-08-13 08:13:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.969906459s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X....X.....X............................................X.] duration:
5.752421465s
FAIL (2025-08-13 08:13:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 08:12:43.003650547 (110h46m37.434730688s) [upload=115290]: Starting upload Aug 13 08:12:43.003699131 (110h46m37.434779262s) [upload=115290]: Done starting upload Aug 13 08:12:43.003827486 (110h46m37.434907638s) [upload=115290]: Uploading segments... Aug 13 08:12:43.003920183 (110h46m37.435000315s) [upload=115290]: Got next segment. Inline: false Aug 13 08:12:43.003958527 (110h46m37.435038669s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 08:12:43.003963326 (110h46m37.435043447s) [upload=115290]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 13 08:12:43.223356610 (110h46m37.654436771s) [upload=115290]: Next segment err: metaclient: Too Many Requests Aug 13 08:12:43.223389503 (110h46m37.654469644s) [upload=115290]: Done uploading segments... Aug 13 08:12:43.223407647 (110h46m37.654487798s) [upload=115290]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.752447706s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|