Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.850999011s
FAIL (2025-08-21 13:17:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.851032044s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..........................................XX........X.....] duration:
5.822983098s
FAIL (2025-08-21 13:17:31 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 13:14:20.581446924 (307h48m15.012527055s) [upload=320207]: Starting upload
Aug 21 13:14:20.581499795 (307h48m15.012579946s) [upload=320207]: Done starting upload
Aug 21 13:14:20.581604014 (307h48m15.012684145s) [upload=320207]: Uploading segments...
Aug 21 13:14:20.581810509 (307h48m15.012890641s) [upload=320207]: Got next segment. Inline: false
Aug 21 13:14:20.581851387 (307h48m15.012931508s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:14:20.581859564 (307h48m15.012939715s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:14:21.175845021 (307h48m15.606925142s) [seg_pos={0 0}, upload=320207]: Begin upload segment...
Aug 21 13:14:21.175887232 (307h48m15.606967363s) [seg_pos={0 0}, upload=320207]: Done begin upload segment.
Aug 21 13:14:21.175911418 (307h48m15.606991549s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.175947417 (307h48m15.607027548s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176276246 (307h48m15.607356377s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176407517 (307h48m15.607487648s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176597751 (307h48m15.607677882s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176697142 (307h48m15.607777273s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176888768 (307h48m15.607968889s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176981926 (307h48m15.608062047s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177197389 (307h48m15.60827751s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177271651 (307h48m15.608351782s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177456584 (307h48m15.608536705s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177674611 (307h48m15.608754742s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177927515 (307h48m15.609007646s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178229834 (307h48m15.609309965s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178449193 (307h48m15.609529324s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178686938 (307h48m15.60976707s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179036107 (307h48m15.610116228s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179237993 (307h48m15.610318114s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:22.313915583 (307h48m16.744995714s) [upload=320207]: Next returned nil segment
Aug 21 13:14:22.313934177 (307h48m16.745014308s) [upload=320207]: Waiting for error group managing segments...
Aug 21 13:14:22.633924761 (307h48m17.065004892s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081015625 (307h48m17.512095757s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081177355 (307h48m17.512257486s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.090727939 (307h48m17.52180807s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.093444697 (307h48m17.524524828s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.114999789 (307h48m17.54607992s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168107254 (307h48m17.599187386s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168706962 (307h48m17.599787093s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193420729 (307h48m17.62450086s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193596846 (307h48m17.624676977s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.210821603 (307h48m17.641901734s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.230503273 (307h48m17.661583404s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.245323018 (307h48m17.676403149s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252659495 (307h48m17.683739626s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252685685 (307h48m17.683765816s) [seg_pos={0 0}, upload=320207]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:14:23.252818570 (307h48m17.683898701s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PdDvzaqwynfuxTsQTFDWvsJKXf7c2dkuKKJFKMXL5Ze7ZJkVu): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252832055 (307h48m17.683912186s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252876691 (307h48m17.683956812s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252938729 (307h48m17.68401886s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m4M9WpEgS8BgLgQ2kwqzb6szQ2k4KMS3pv6DRQsEPS2ujPyLM): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252962525 (307h48m17.684042646s) [seg_pos={0 0}, upload=320207]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:14:23.253036447 (307h48m17.684116568s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:14:23.253041085 (307h48m17.684121206s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:14:24.483452789 (307h48m18.91453292s) [upload=320207]: Done uploading segments...
Aug 21 13:14:24.483472315 (307h48m18.914552436s) [upload=320207]: Upload finished. err: <nil>
Duration: 5.823011351s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.995528701s
FAIL (2025-08-21 13:17:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.995554941s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..........................................XX........X....] duration:
5.855975638s
FAIL (2025-08-21 13:17:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 13:14:20.581446924 (307h48m15.012527055s) [upload=320207]: Starting upload
Aug 21 13:14:20.581499795 (307h48m15.012579946s) [upload=320207]: Done starting upload
Aug 21 13:14:20.581604014 (307h48m15.012684145s) [upload=320207]: Uploading segments...
Aug 21 13:14:20.581810509 (307h48m15.012890641s) [upload=320207]: Got next segment. Inline: false
Aug 21 13:14:20.581851387 (307h48m15.012931508s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:14:20.581859564 (307h48m15.012939715s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:14:21.175845021 (307h48m15.606925142s) [seg_pos={0 0}, upload=320207]: Begin upload segment...
Aug 21 13:14:21.175887232 (307h48m15.606967363s) [seg_pos={0 0}, upload=320207]: Done begin upload segment.
Aug 21 13:14:21.175911418 (307h48m15.606991549s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.175947417 (307h48m15.607027548s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176276246 (307h48m15.607356377s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176407517 (307h48m15.607487648s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176597751 (307h48m15.607677882s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176697142 (307h48m15.607777273s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176888768 (307h48m15.607968889s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176981926 (307h48m15.608062047s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177197389 (307h48m15.60827751s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177271651 (307h48m15.608351782s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177456584 (307h48m15.608536705s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177674611 (307h48m15.608754742s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177927515 (307h48m15.609007646s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178229834 (307h48m15.609309965s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178449193 (307h48m15.609529324s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178686938 (307h48m15.60976707s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179036107 (307h48m15.610116228s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179237993 (307h48m15.610318114s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:22.313915583 (307h48m16.744995714s) [upload=320207]: Next returned nil segment
Aug 21 13:14:22.313934177 (307h48m16.745014308s) [upload=320207]: Waiting for error group managing segments...
Aug 21 13:14:22.633924761 (307h48m17.065004892s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081015625 (307h48m17.512095757s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081177355 (307h48m17.512257486s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.090727939 (307h48m17.52180807s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.093444697 (307h48m17.524524828s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.114999789 (307h48m17.54607992s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168107254 (307h48m17.599187386s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168706962 (307h48m17.599787093s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193420729 (307h48m17.62450086s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193596846 (307h48m17.624676977s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.210821603 (307h48m17.641901734s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.230503273 (307h48m17.661583404s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.245323018 (307h48m17.676403149s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252659495 (307h48m17.683739626s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252685685 (307h48m17.683765816s) [seg_pos={0 0}, upload=320207]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:14:23.252818570 (307h48m17.683898701s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PdDvzaqwynfuxTsQTFDWvsJKXf7c2dkuKKJFKMXL5Ze7ZJkVu): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252832055 (307h48m17.683912186s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252876691 (307h48m17.683956812s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252938729 (307h48m17.68401886s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m4M9WpEgS8BgLgQ2kwqzb6szQ2k4KMS3pv6DRQsEPS2ujPyLM): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252962525 (307h48m17.684042646s) [seg_pos={0 0}, upload=320207]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:14:23.253036447 (307h48m17.684116568s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:14:23.253041085 (307h48m17.684121206s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:14:24.483452789 (307h48m18.91453292s) [upload=320207]: Done uploading segments...
Aug 21 13:14:24.483472315 (307h48m18.914552436s) [upload=320207]: Upload finished. err: <nil>
Duration: 5.856027276s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.109655009s
FAIL (2025-08-21 13:16:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.109683884s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..........................................XX........X...] duration:
5.799961152s
FAIL (2025-08-21 13:16:16 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 13:14:20.581446924 (307h48m15.012527055s) [upload=320207]: Starting upload
Aug 21 13:14:20.581499795 (307h48m15.012579946s) [upload=320207]: Done starting upload
Aug 21 13:14:20.581604014 (307h48m15.012684145s) [upload=320207]: Uploading segments...
Aug 21 13:14:20.581810509 (307h48m15.012890641s) [upload=320207]: Got next segment. Inline: false
Aug 21 13:14:20.581851387 (307h48m15.012931508s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:14:20.581859564 (307h48m15.012939715s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:14:21.175845021 (307h48m15.606925142s) [seg_pos={0 0}, upload=320207]: Begin upload segment...
Aug 21 13:14:21.175887232 (307h48m15.606967363s) [seg_pos={0 0}, upload=320207]: Done begin upload segment.
Aug 21 13:14:21.175911418 (307h48m15.606991549s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.175947417 (307h48m15.607027548s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176276246 (307h48m15.607356377s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176407517 (307h48m15.607487648s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176597751 (307h48m15.607677882s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176697142 (307h48m15.607777273s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176888768 (307h48m15.607968889s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176981926 (307h48m15.608062047s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177197389 (307h48m15.60827751s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177271651 (307h48m15.608351782s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177456584 (307h48m15.608536705s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177674611 (307h48m15.608754742s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177927515 (307h48m15.609007646s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178229834 (307h48m15.609309965s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178449193 (307h48m15.609529324s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178686938 (307h48m15.60976707s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179036107 (307h48m15.610116228s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179237993 (307h48m15.610318114s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:22.313915583 (307h48m16.744995714s) [upload=320207]: Next returned nil segment
Aug 21 13:14:22.313934177 (307h48m16.745014308s) [upload=320207]: Waiting for error group managing segments...
Aug 21 13:14:22.633924761 (307h48m17.065004892s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081015625 (307h48m17.512095757s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081177355 (307h48m17.512257486s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.090727939 (307h48m17.52180807s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.093444697 (307h48m17.524524828s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.114999789 (307h48m17.54607992s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168107254 (307h48m17.599187386s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168706962 (307h48m17.599787093s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193420729 (307h48m17.62450086s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193596846 (307h48m17.624676977s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.210821603 (307h48m17.641901734s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.230503273 (307h48m17.661583404s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.245323018 (307h48m17.676403149s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252659495 (307h48m17.683739626s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252685685 (307h48m17.683765816s) [seg_pos={0 0}, upload=320207]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:14:23.252818570 (307h48m17.683898701s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PdDvzaqwynfuxTsQTFDWvsJKXf7c2dkuKKJFKMXL5Ze7ZJkVu): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252832055 (307h48m17.683912186s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252876691 (307h48m17.683956812s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252938729 (307h48m17.68401886s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m4M9WpEgS8BgLgQ2kwqzb6szQ2k4KMS3pv6DRQsEPS2ujPyLM): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252962525 (307h48m17.684042646s) [seg_pos={0 0}, upload=320207]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:14:23.253036447 (307h48m17.684116568s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:14:23.253041085 (307h48m17.684121206s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:14:24.483452789 (307h48m18.91453292s) [upload=320207]: Done uploading segments...
Aug 21 13:14:24.483472315 (307h48m18.914552436s) [upload=320207]: Upload finished. err: <nil>
Duration: 5.799986571s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X...X..........................................XX........X..] duration:
6.120273066s
FAIL (2025-08-21 13:15:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 13:14:20.581446924 (307h48m15.012527055s) [upload=320207]: Starting upload
Aug 21 13:14:20.581499795 (307h48m15.012579946s) [upload=320207]: Done starting upload
Aug 21 13:14:20.581604014 (307h48m15.012684145s) [upload=320207]: Uploading segments...
Aug 21 13:14:20.581810509 (307h48m15.012890641s) [upload=320207]: Got next segment. Inline: false
Aug 21 13:14:20.581851387 (307h48m15.012931508s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:14:20.581859564 (307h48m15.012939715s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:14:21.175845021 (307h48m15.606925142s) [seg_pos={0 0}, upload=320207]: Begin upload segment...
Aug 21 13:14:21.175887232 (307h48m15.606967363s) [seg_pos={0 0}, upload=320207]: Done begin upload segment.
Aug 21 13:14:21.175911418 (307h48m15.606991549s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.175947417 (307h48m15.607027548s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176276246 (307h48m15.607356377s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176407517 (307h48m15.607487648s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176597751 (307h48m15.607677882s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176697142 (307h48m15.607777273s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176888768 (307h48m15.607968889s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176981926 (307h48m15.608062047s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177197389 (307h48m15.60827751s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177271651 (307h48m15.608351782s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177456584 (307h48m15.608536705s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177674611 (307h48m15.608754742s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177927515 (307h48m15.609007646s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178229834 (307h48m15.609309965s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178449193 (307h48m15.609529324s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178686938 (307h48m15.60976707s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179036107 (307h48m15.610116228s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179237993 (307h48m15.610318114s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:22.313915583 (307h48m16.744995714s) [upload=320207]: Next returned nil segment
Aug 21 13:14:22.313934177 (307h48m16.745014308s) [upload=320207]: Waiting for error group managing segments...
Aug 21 13:14:22.633924761 (307h48m17.065004892s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081015625 (307h48m17.512095757s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081177355 (307h48m17.512257486s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.090727939 (307h48m17.52180807s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.093444697 (307h48m17.524524828s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.114999789 (307h48m17.54607992s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168107254 (307h48m17.599187386s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168706962 (307h48m17.599787093s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193420729 (307h48m17.62450086s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193596846 (307h48m17.624676977s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.210821603 (307h48m17.641901734s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.230503273 (307h48m17.661583404s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.245323018 (307h48m17.676403149s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252659495 (307h48m17.683739626s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252685685 (307h48m17.683765816s) [seg_pos={0 0}, upload=320207]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:14:23.252818570 (307h48m17.683898701s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PdDvzaqwynfuxTsQTFDWvsJKXf7c2dkuKKJFKMXL5Ze7ZJkVu): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252832055 (307h48m17.683912186s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252876691 (307h48m17.683956812s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252938729 (307h48m17.68401886s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m4M9WpEgS8BgLgQ2kwqzb6szQ2k4KMS3pv6DRQsEPS2ujPyLM): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252962525 (307h48m17.684042646s) [seg_pos={0 0}, upload=320207]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:14:23.253036447 (307h48m17.684116568s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:14:23.253041085 (307h48m17.684121206s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:14:24.483452789 (307h48m18.91453292s) [upload=320207]: Done uploading segments...
Aug 21 13:14:24.483472315 (307h48m18.914552436s) [upload=320207]: Upload finished. err: <nil>
Duration: 6.12030143s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
3.77555818s
FAIL (2025-08-21 13:15:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.775584s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X...X..........................................XX........X.] duration:
6.154794803s
FAIL (2025-08-21 13:14:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 13:14:20.581446924 (307h48m15.012527055s) [upload=320207]: Starting upload
Aug 21 13:14:20.581499795 (307h48m15.012579946s) [upload=320207]: Done starting upload
Aug 21 13:14:20.581604014 (307h48m15.012684145s) [upload=320207]: Uploading segments...
Aug 21 13:14:20.581810509 (307h48m15.012890641s) [upload=320207]: Got next segment. Inline: false
Aug 21 13:14:20.581851387 (307h48m15.012931508s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:14:20.581859564 (307h48m15.012939715s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:14:21.175845021 (307h48m15.606925142s) [seg_pos={0 0}, upload=320207]: Begin upload segment...
Aug 21 13:14:21.175887232 (307h48m15.606967363s) [seg_pos={0 0}, upload=320207]: Done begin upload segment.
Aug 21 13:14:21.175911418 (307h48m15.606991549s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.175947417 (307h48m15.607027548s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176276246 (307h48m15.607356377s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176407517 (307h48m15.607487648s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176597751 (307h48m15.607677882s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176697142 (307h48m15.607777273s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176888768 (307h48m15.607968889s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176981926 (307h48m15.608062047s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177197389 (307h48m15.60827751s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177271651 (307h48m15.608351782s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177456584 (307h48m15.608536705s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177674611 (307h48m15.608754742s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177927515 (307h48m15.609007646s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178229834 (307h48m15.609309965s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178449193 (307h48m15.609529324s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178686938 (307h48m15.60976707s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179036107 (307h48m15.610116228s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179237993 (307h48m15.610318114s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:22.313915583 (307h48m16.744995714s) [upload=320207]: Next returned nil segment
Aug 21 13:14:22.313934177 (307h48m16.745014308s) [upload=320207]: Waiting for error group managing segments...
Aug 21 13:14:22.633924761 (307h48m17.065004892s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081015625 (307h48m17.512095757s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081177355 (307h48m17.512257486s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.090727939 (307h48m17.52180807s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.093444697 (307h48m17.524524828s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.114999789 (307h48m17.54607992s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168107254 (307h48m17.599187386s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168706962 (307h48m17.599787093s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193420729 (307h48m17.62450086s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193596846 (307h48m17.624676977s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.210821603 (307h48m17.641901734s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.230503273 (307h48m17.661583404s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.245323018 (307h48m17.676403149s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252659495 (307h48m17.683739626s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252685685 (307h48m17.683765816s) [seg_pos={0 0}, upload=320207]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:14:23.252818570 (307h48m17.683898701s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PdDvzaqwynfuxTsQTFDWvsJKXf7c2dkuKKJFKMXL5Ze7ZJkVu): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252832055 (307h48m17.683912186s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252876691 (307h48m17.683956812s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252938729 (307h48m17.68401886s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m4M9WpEgS8BgLgQ2kwqzb6szQ2k4KMS3pv6DRQsEPS2ujPyLM): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252962525 (307h48m17.684042646s) [seg_pos={0 0}, upload=320207]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:14:23.253036447 (307h48m17.684116568s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:14:23.253041085 (307h48m17.684121206s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:14:24.483452789 (307h48m18.91453292s) [upload=320207]: Done uploading segments...
Aug 21 13:14:24.483472315 (307h48m18.914552436s) [upload=320207]: Upload finished. err: <nil>
Duration: 6.154822105s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X...X..........................................XX........X] duration:
5.40748576s
FAIL (2025-08-21 13:14:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 21 13:14:20.581446924 (307h48m15.012527055s) [upload=320207]: Starting upload
Aug 21 13:14:20.581499795 (307h48m15.012579946s) [upload=320207]: Done starting upload
Aug 21 13:14:20.581604014 (307h48m15.012684145s) [upload=320207]: Uploading segments...
Aug 21 13:14:20.581810509 (307h48m15.012890641s) [upload=320207]: Got next segment. Inline: false
Aug 21 13:14:20.581851387 (307h48m15.012931508s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:14:20.581859564 (307h48m15.012939715s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:14:21.175845021 (307h48m15.606925142s) [seg_pos={0 0}, upload=320207]: Begin upload segment...
Aug 21 13:14:21.175887232 (307h48m15.606967363s) [seg_pos={0 0}, upload=320207]: Done begin upload segment.
Aug 21 13:14:21.175911418 (307h48m15.606991549s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.175947417 (307h48m15.607027548s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176276246 (307h48m15.607356377s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176407517 (307h48m15.607487648s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176597751 (307h48m15.607677882s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176697142 (307h48m15.607777273s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176888768 (307h48m15.607968889s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.176981926 (307h48m15.608062047s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177197389 (307h48m15.60827751s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177271651 (307h48m15.608351782s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177456584 (307h48m15.608536705s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177674611 (307h48m15.608754742s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.177927515 (307h48m15.609007646s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178229834 (307h48m15.609309965s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178449193 (307h48m15.609529324s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.178686938 (307h48m15.60976707s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179036107 (307h48m15.610116228s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:21.179237993 (307h48m15.610318114s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Uploading piece...
Aug 21 13:14:22.313915583 (307h48m16.744995714s) [upload=320207]: Next returned nil segment
Aug 21 13:14:22.313934177 (307h48m16.745014308s) [upload=320207]: Waiting for error group managing segments...
Aug 21 13:14:22.633924761 (307h48m17.065004892s) [noise=true , address=79.127.205.245:4241 , piece_id=EM2FWWRLS76SRNTFZEOQ3MTO57I6JIA3UDJCAFWFMLD5YCTSJJ2A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081015625 (307h48m17.512095757s) [noise=true , address=77.90.31.18:4809 , piece_id=VQKFDSDYF624QCXOQUOY7GWOWPO34DOSJMOAK4IGYQZMKR35TXWQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.081177355 (307h48m17.512257486s) [noise=true , address=79.127.219.51:4202 , piece_id=OYZ4TFH44VWC5WELGBXPRLMFVJZ7GOHYYOMRHUWHAXQOQWZKALNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.090727939 (307h48m17.52180807s) [noise=true , address=104.36.82.49:4004 , piece_id=3Z453I7EYXYQRH4VXJVNPWUX5UTFSVOHMVCDIOTQG4VOAOY6YWZA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.093444697 (307h48m17.524524828s) [noise=true , address=77.90.31.16:4741 , piece_id=6W43XT4ZEJKMOTSRQI254LJIA5FQYEXAIAF4LJG3NQ6RCRYHRZZQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.114999789 (307h48m17.54607992s) [noise=true , address=45.91.116.6:4007 , piece_id=P3FKMGORY4JBCTIEVFXQS2MSSJKXHB7QVVTRWVN5JMCAN7X2XMYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168107254 (307h48m17.599187386s) [noise=true , address=77.90.31.19:4874 , piece_id=RXZOVAA7C75AC47RPALWP5EQCL4VBD3NLUDZKRWXSZPWEQRP4GTA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.168706962 (307h48m17.599787093s) [noise=true , address=77.90.31.10:4538 , piece_id=OV6NQTJ6WIFSXHNL2SIHDFADCKYNC633XU55SUFJITY2T2JRX7MQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193420729 (307h48m17.62450086s) [noise=true , address=77.90.31.13:4649 , piece_id=JZGJNEG4POQQXLAKXUJAGIGOATTVHDMHJMUOP4SEFHFX7V72IC5A, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.193596846 (307h48m17.624676977s) [noise=true , address=104.36.82.19:4420 , piece_id=74DPCX2HHVPXQCG7K6AUNAXV5XHPFQF24J6FXZ2P7JPOGFU7DUMA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.210821603 (307h48m17.641901734s) [noise=true , address=104.36.82.5:4870 , piece_id=2MAFZF5GFLJ3J452YZO7W2PZVS4LABRLJ4DJM2V2CUIIV2VZEXFQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.230503273 (307h48m17.661583404s) [noise=true , address=77.90.31.17:4787 , piece_id=YADCIBGD2ZXM2BFB32O77GTGIEERUZCZJDUYVUUJWF56WV2YSWLA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.245323018 (307h48m17.676403149s) [noise=true , address=104.36.82.9:4014 , piece_id=AZXICORY4ZUI7RJERG6NXS5RUBPZWLSSI3T22XVAX3ZWLZP6CNCA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252659495 (307h48m17.683739626s) [noise=true , address=45.91.116.11:4133 , piece_id=ISYM6PH6OUAB3RKYHEZPMYAXGM25QFAIKMRAPG5KH3JZV2QGS6FA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: <nil>
Aug 21 13:14:23.252685685 (307h48m17.683765816s) [seg_pos={0 0}, upload=320207]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:14:23.252818570 (307h48m17.683898701s) [noise=true , address=156.146.43.225:4438 , piece_id=Y2DQE42TAURXSMYLWXV6D3MNXWRNPDPE3JKXFULJGZLBDL32SCEA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PdDvzaqwynfuxTsQTFDWvsJKXf7c2dkuKKJFKMXL5Ze7ZJkVu): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252832055 (307h48m17.683912186s) [noise=true , address=104.36.82.60:4353 , piece_id=DHC4EEQIJXRQ5YKDEUNUUQTM247HQJOSW3WLRG6TNWWS52FVBSYQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252876691 (307h48m17.683956812s) [noise=true , address=104.36.82.23:4472 , piece_id=EJALBOPAMF52PORNLAQILI23QZZDGDZJICE67VVIVMY6WVOVZZNA, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12otbB1RmPUKSKo813hrKPQVAyeqmhjhApxi6ndtHBCfn9bGGct): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252938729 (307h48m17.68401886s) [noise=true , address=77.90.31.11:4578 , piece_id=5TUQHJRLICV5XLAUDLKUMBCVWCLX4QJSXFTL764Z6RF6DOJE6RDQ, seg_pos={0 0}, upload=320207]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m4M9WpEgS8BgLgQ2kwqzb6szQ2k4KMS3pv6DRQsEPS2ujPyLM): protocol: expected piece hash; context canceled; EOF
Aug 21 13:14:23.252962525 (307h48m17.684042646s) [seg_pos={0 0}, upload=320207]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:14:23.253036447 (307h48m17.684116568s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:14:23.253041085 (307h48m17.684121206s) [upload=320207]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:14:24.483452789 (307h48m18.91453292s) [upload=320207]: Done uploading segments...
Aug 21 13:14:24.483472315 (307h48m18.914552436s) [upload=320207]: Upload finished. err: <nil>
Duration: 5.407522359s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.239832768s
FAIL (2025-08-21 13:14:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.239892011s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X...X..........................................XX........] duration:
6.168304803s
FAIL (2025-08-21 13:13:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 13:07:00.136945386 (307h40m54.568025527s) [upload=320084]: Starting upload
Aug 21 13:07:00.137011994 (307h40m54.568092145s) [upload=320084]: Done starting upload
Aug 21 13:07:00.137095163 (307h40m54.568175284s) [upload=320084]: Uploading segments...
Aug 21 13:07:00.137304974 (307h40m54.568385105s) [upload=320084]: Got next segment. Inline: false
Aug 21 13:07:00.137345672 (307h40m54.568425803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:07:00.137350672 (307h40m54.568430803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:07:00.588225794 (307h40m55.019305925s) [seg_pos={0 0}, upload=320084]: Begin upload segment...
Aug 21 13:07:00.588279717 (307h40m55.019359848s) [seg_pos={0 0}, upload=320084]: Done begin upload segment.
Aug 21 13:07:00.588301509 (307h40m55.01938164s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588434223 (307h40m55.019514395s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588706314 (307h40m55.019786445s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588980499 (307h40m55.02006063s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589249422 (307h40m55.020329554s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589507317 (307h40m55.020587478s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589531773 (307h40m55.020611894s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589897242 (307h40m55.020977373s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590125078 (307h40m55.021205209s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590204410 (307h40m55.021284531s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590332385 (307h40m55.021412516s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590540673 (307h40m55.021620794s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590773820 (307h40m55.021853961s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591208391 (307h40m55.022288522s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591652842 (307h40m55.022732963s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592103483 (307h40m55.023183614s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592521354 (307h40m55.023601485s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.600360373 (307h40m55.031440504s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:01.743737381 (307h40m56.174817512s) [upload=320084]: Next returned nil segment
Aug 21 13:07:01.743760444 (307h40m56.174840575s) [upload=320084]: Waiting for error group managing segments...
Aug 21 13:07:02.034318641 (307h40m56.465398772s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.485347157 (307h40m56.916427288s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.524208433 (307h40m56.955288574s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.542337311 (307h40m56.973417442s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.552707754 (307h40m56.983787885s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.636957334 (307h40m57.068037465s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.656637741 (307h40m57.087717872s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.676220850 (307h40m57.107300981s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.700667776 (307h40m57.131747907s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.705226258 (307h40m57.136306379s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.757369869 (307h40m57.18845s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.780920480 (307h40m57.212000611s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.784900966 (307h40m57.215981097s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914499627 (307h40m57.345579758s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914526038 (307h40m57.345606159s) [seg_pos={0 0}, upload=320084]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:07:02.914694540 (307h40m57.345774671s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RvAMfdBV73d3kLZMSU3vQVSdv8Ef95eeYzrQeQAosYgZqF65k): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914797227 (307h40m57.345877358s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914833045 (307h40m57.345913166s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914893120 (307h40m57.345973251s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3SVXrhJsmYTXR4vDSkfaiqDRox21u17SLmQc9sEab1B7zZRr): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914908810 (307h40m57.345988941s) [seg_pos={0 0}, upload=320084]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:07:02.914972331 (307h40m57.346052462s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:07:02.914976831 (307h40m57.346056952s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:07:03.238105746 (307h40m57.669185878s) [upload=320084]: Done uploading segments...
Aug 21 13:07:03.238123691 (307h40m57.669203822s) [upload=320084]: Upload finished. err: <nil>
Duration: 6.168334962s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.488779228s
FAIL (2025-08-21 13:13:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.488806161s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X...X..........................................XX.......] duration:
5.977287912s
FAIL (2025-08-21 13:12:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 13:07:00.136945386 (307h40m54.568025527s) [upload=320084]: Starting upload
Aug 21 13:07:00.137011994 (307h40m54.568092145s) [upload=320084]: Done starting upload
Aug 21 13:07:00.137095163 (307h40m54.568175284s) [upload=320084]: Uploading segments...
Aug 21 13:07:00.137304974 (307h40m54.568385105s) [upload=320084]: Got next segment. Inline: false
Aug 21 13:07:00.137345672 (307h40m54.568425803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:07:00.137350672 (307h40m54.568430803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:07:00.588225794 (307h40m55.019305925s) [seg_pos={0 0}, upload=320084]: Begin upload segment...
Aug 21 13:07:00.588279717 (307h40m55.019359848s) [seg_pos={0 0}, upload=320084]: Done begin upload segment.
Aug 21 13:07:00.588301509 (307h40m55.01938164s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588434223 (307h40m55.019514395s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588706314 (307h40m55.019786445s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588980499 (307h40m55.02006063s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589249422 (307h40m55.020329554s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589507317 (307h40m55.020587478s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589531773 (307h40m55.020611894s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589897242 (307h40m55.020977373s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590125078 (307h40m55.021205209s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590204410 (307h40m55.021284531s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590332385 (307h40m55.021412516s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590540673 (307h40m55.021620794s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590773820 (307h40m55.021853961s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591208391 (307h40m55.022288522s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591652842 (307h40m55.022732963s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592103483 (307h40m55.023183614s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592521354 (307h40m55.023601485s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.600360373 (307h40m55.031440504s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:01.743737381 (307h40m56.174817512s) [upload=320084]: Next returned nil segment
Aug 21 13:07:01.743760444 (307h40m56.174840575s) [upload=320084]: Waiting for error group managing segments...
Aug 21 13:07:02.034318641 (307h40m56.465398772s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.485347157 (307h40m56.916427288s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.524208433 (307h40m56.955288574s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.542337311 (307h40m56.973417442s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.552707754 (307h40m56.983787885s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.636957334 (307h40m57.068037465s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.656637741 (307h40m57.087717872s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.676220850 (307h40m57.107300981s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.700667776 (307h40m57.131747907s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.705226258 (307h40m57.136306379s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.757369869 (307h40m57.18845s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.780920480 (307h40m57.212000611s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.784900966 (307h40m57.215981097s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914499627 (307h40m57.345579758s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914526038 (307h40m57.345606159s) [seg_pos={0 0}, upload=320084]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:07:02.914694540 (307h40m57.345774671s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RvAMfdBV73d3kLZMSU3vQVSdv8Ef95eeYzrQeQAosYgZqF65k): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914797227 (307h40m57.345877358s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914833045 (307h40m57.345913166s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914893120 (307h40m57.345973251s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3SVXrhJsmYTXR4vDSkfaiqDRox21u17SLmQc9sEab1B7zZRr): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914908810 (307h40m57.345988941s) [seg_pos={0 0}, upload=320084]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:07:02.914972331 (307h40m57.346052462s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:07:02.914976831 (307h40m57.346056952s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:07:03.238105746 (307h40m57.669185878s) [upload=320084]: Done uploading segments...
Aug 21 13:07:03.238123691 (307h40m57.669203822s) [upload=320084]: Upload finished. err: <nil>
Duration: 5.97732836s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.072312307s
FAIL (2025-08-21 13:12:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.07233428s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X...X..........................................XX......] duration:
5.992254413s
FAIL (2025-08-21 13:11:34 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 13:07:00.136945386 (307h40m54.568025527s) [upload=320084]: Starting upload
Aug 21 13:07:00.137011994 (307h40m54.568092145s) [upload=320084]: Done starting upload
Aug 21 13:07:00.137095163 (307h40m54.568175284s) [upload=320084]: Uploading segments...
Aug 21 13:07:00.137304974 (307h40m54.568385105s) [upload=320084]: Got next segment. Inline: false
Aug 21 13:07:00.137345672 (307h40m54.568425803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:07:00.137350672 (307h40m54.568430803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:07:00.588225794 (307h40m55.019305925s) [seg_pos={0 0}, upload=320084]: Begin upload segment...
Aug 21 13:07:00.588279717 (307h40m55.019359848s) [seg_pos={0 0}, upload=320084]: Done begin upload segment.
Aug 21 13:07:00.588301509 (307h40m55.01938164s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588434223 (307h40m55.019514395s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588706314 (307h40m55.019786445s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588980499 (307h40m55.02006063s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589249422 (307h40m55.020329554s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589507317 (307h40m55.020587478s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589531773 (307h40m55.020611894s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589897242 (307h40m55.020977373s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590125078 (307h40m55.021205209s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590204410 (307h40m55.021284531s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590332385 (307h40m55.021412516s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590540673 (307h40m55.021620794s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590773820 (307h40m55.021853961s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591208391 (307h40m55.022288522s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591652842 (307h40m55.022732963s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592103483 (307h40m55.023183614s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592521354 (307h40m55.023601485s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.600360373 (307h40m55.031440504s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:01.743737381 (307h40m56.174817512s) [upload=320084]: Next returned nil segment
Aug 21 13:07:01.743760444 (307h40m56.174840575s) [upload=320084]: Waiting for error group managing segments...
Aug 21 13:07:02.034318641 (307h40m56.465398772s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.485347157 (307h40m56.916427288s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.524208433 (307h40m56.955288574s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.542337311 (307h40m56.973417442s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.552707754 (307h40m56.983787885s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.636957334 (307h40m57.068037465s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.656637741 (307h40m57.087717872s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.676220850 (307h40m57.107300981s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.700667776 (307h40m57.131747907s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.705226258 (307h40m57.136306379s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.757369869 (307h40m57.18845s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.780920480 (307h40m57.212000611s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.784900966 (307h40m57.215981097s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914499627 (307h40m57.345579758s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914526038 (307h40m57.345606159s) [seg_pos={0 0}, upload=320084]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:07:02.914694540 (307h40m57.345774671s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RvAMfdBV73d3kLZMSU3vQVSdv8Ef95eeYzrQeQAosYgZqF65k): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914797227 (307h40m57.345877358s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914833045 (307h40m57.345913166s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914893120 (307h40m57.345973251s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3SVXrhJsmYTXR4vDSkfaiqDRox21u17SLmQc9sEab1B7zZRr): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914908810 (307h40m57.345988941s) [seg_pos={0 0}, upload=320084]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:07:02.914972331 (307h40m57.346052462s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:07:02.914976831 (307h40m57.346056952s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:07:03.238105746 (307h40m57.669185878s) [upload=320084]: Done uploading segments...
Aug 21 13:07:03.238123691 (307h40m57.669203822s) [upload=320084]: Upload finished. err: <nil>
Duration: 5.99227925s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.160832212s
FAIL (2025-08-21 13:11:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.160864514s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X...X..........................................XX.....] duration:
5.941478205s
FAIL (2025-08-21 13:10:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 13:07:00.136945386 (307h40m54.568025527s) [upload=320084]: Starting upload
Aug 21 13:07:00.137011994 (307h40m54.568092145s) [upload=320084]: Done starting upload
Aug 21 13:07:00.137095163 (307h40m54.568175284s) [upload=320084]: Uploading segments...
Aug 21 13:07:00.137304974 (307h40m54.568385105s) [upload=320084]: Got next segment. Inline: false
Aug 21 13:07:00.137345672 (307h40m54.568425803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:07:00.137350672 (307h40m54.568430803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:07:00.588225794 (307h40m55.019305925s) [seg_pos={0 0}, upload=320084]: Begin upload segment...
Aug 21 13:07:00.588279717 (307h40m55.019359848s) [seg_pos={0 0}, upload=320084]: Done begin upload segment.
Aug 21 13:07:00.588301509 (307h40m55.01938164s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588434223 (307h40m55.019514395s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588706314 (307h40m55.019786445s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588980499 (307h40m55.02006063s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589249422 (307h40m55.020329554s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589507317 (307h40m55.020587478s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589531773 (307h40m55.020611894s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589897242 (307h40m55.020977373s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590125078 (307h40m55.021205209s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590204410 (307h40m55.021284531s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590332385 (307h40m55.021412516s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590540673 (307h40m55.021620794s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590773820 (307h40m55.021853961s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591208391 (307h40m55.022288522s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591652842 (307h40m55.022732963s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592103483 (307h40m55.023183614s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592521354 (307h40m55.023601485s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.600360373 (307h40m55.031440504s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:01.743737381 (307h40m56.174817512s) [upload=320084]: Next returned nil segment
Aug 21 13:07:01.743760444 (307h40m56.174840575s) [upload=320084]: Waiting for error group managing segments...
Aug 21 13:07:02.034318641 (307h40m56.465398772s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.485347157 (307h40m56.916427288s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.524208433 (307h40m56.955288574s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.542337311 (307h40m56.973417442s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.552707754 (307h40m56.983787885s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.636957334 (307h40m57.068037465s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.656637741 (307h40m57.087717872s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.676220850 (307h40m57.107300981s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.700667776 (307h40m57.131747907s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.705226258 (307h40m57.136306379s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.757369869 (307h40m57.18845s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.780920480 (307h40m57.212000611s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.784900966 (307h40m57.215981097s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914499627 (307h40m57.345579758s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914526038 (307h40m57.345606159s) [seg_pos={0 0}, upload=320084]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:07:02.914694540 (307h40m57.345774671s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RvAMfdBV73d3kLZMSU3vQVSdv8Ef95eeYzrQeQAosYgZqF65k): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914797227 (307h40m57.345877358s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914833045 (307h40m57.345913166s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914893120 (307h40m57.345973251s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3SVXrhJsmYTXR4vDSkfaiqDRox21u17SLmQc9sEab1B7zZRr): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914908810 (307h40m57.345988941s) [seg_pos={0 0}, upload=320084]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:07:02.914972331 (307h40m57.346052462s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:07:02.914976831 (307h40m57.346056952s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:07:03.238105746 (307h40m57.669185878s) [upload=320084]: Done uploading segments...
Aug 21 13:07:03.238123691 (307h40m57.669203822s) [upload=320084]: Upload finished. err: <nil>
Duration: 5.941498333s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.45212869s
FAIL (2025-08-21 13:10:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.452162836s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......X...X..........................................XX....] duration:
6.338397156s
FAIL (2025-08-21 13:09:58 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 13:07:00.136945386 (307h40m54.568025527s) [upload=320084]: Starting upload
Aug 21 13:07:00.137011994 (307h40m54.568092145s) [upload=320084]: Done starting upload
Aug 21 13:07:00.137095163 (307h40m54.568175284s) [upload=320084]: Uploading segments...
Aug 21 13:07:00.137304974 (307h40m54.568385105s) [upload=320084]: Got next segment. Inline: false
Aug 21 13:07:00.137345672 (307h40m54.568425803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:07:00.137350672 (307h40m54.568430803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:07:00.588225794 (307h40m55.019305925s) [seg_pos={0 0}, upload=320084]: Begin upload segment...
Aug 21 13:07:00.588279717 (307h40m55.019359848s) [seg_pos={0 0}, upload=320084]: Done begin upload segment.
Aug 21 13:07:00.588301509 (307h40m55.01938164s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588434223 (307h40m55.019514395s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588706314 (307h40m55.019786445s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588980499 (307h40m55.02006063s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589249422 (307h40m55.020329554s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589507317 (307h40m55.020587478s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589531773 (307h40m55.020611894s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589897242 (307h40m55.020977373s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590125078 (307h40m55.021205209s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590204410 (307h40m55.021284531s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590332385 (307h40m55.021412516s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590540673 (307h40m55.021620794s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590773820 (307h40m55.021853961s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591208391 (307h40m55.022288522s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591652842 (307h40m55.022732963s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592103483 (307h40m55.023183614s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592521354 (307h40m55.023601485s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.600360373 (307h40m55.031440504s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:01.743737381 (307h40m56.174817512s) [upload=320084]: Next returned nil segment
Aug 21 13:07:01.743760444 (307h40m56.174840575s) [upload=320084]: Waiting for error group managing segments...
Aug 21 13:07:02.034318641 (307h40m56.465398772s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.485347157 (307h40m56.916427288s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.524208433 (307h40m56.955288574s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.542337311 (307h40m56.973417442s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.552707754 (307h40m56.983787885s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.636957334 (307h40m57.068037465s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.656637741 (307h40m57.087717872s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.676220850 (307h40m57.107300981s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.700667776 (307h40m57.131747907s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.705226258 (307h40m57.136306379s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.757369869 (307h40m57.18845s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.780920480 (307h40m57.212000611s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.784900966 (307h40m57.215981097s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914499627 (307h40m57.345579758s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914526038 (307h40m57.345606159s) [seg_pos={0 0}, upload=320084]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:07:02.914694540 (307h40m57.345774671s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RvAMfdBV73d3kLZMSU3vQVSdv8Ef95eeYzrQeQAosYgZqF65k): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914797227 (307h40m57.345877358s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914833045 (307h40m57.345913166s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914893120 (307h40m57.345973251s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3SVXrhJsmYTXR4vDSkfaiqDRox21u17SLmQc9sEab1B7zZRr): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914908810 (307h40m57.345988941s) [seg_pos={0 0}, upload=320084]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:07:02.914972331 (307h40m57.346052462s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:07:02.914976831 (307h40m57.346056952s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:07:03.238105746 (307h40m57.669185878s) [upload=320084]: Done uploading segments...
Aug 21 13:07:03.238123691 (307h40m57.669203822s) [upload=320084]: Upload finished. err: <nil>
Duration: 6.338433574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.684711581s
FAIL (2025-08-21 13:09:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.684734485s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........X...X..........................................XX...] duration:
6.426298816s
FAIL (2025-08-21 13:09:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 13:07:00.136945386 (307h40m54.568025527s) [upload=320084]: Starting upload
Aug 21 13:07:00.137011994 (307h40m54.568092145s) [upload=320084]: Done starting upload
Aug 21 13:07:00.137095163 (307h40m54.568175284s) [upload=320084]: Uploading segments...
Aug 21 13:07:00.137304974 (307h40m54.568385105s) [upload=320084]: Got next segment. Inline: false
Aug 21 13:07:00.137345672 (307h40m54.568425803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:07:00.137350672 (307h40m54.568430803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:07:00.588225794 (307h40m55.019305925s) [seg_pos={0 0}, upload=320084]: Begin upload segment...
Aug 21 13:07:00.588279717 (307h40m55.019359848s) [seg_pos={0 0}, upload=320084]: Done begin upload segment.
Aug 21 13:07:00.588301509 (307h40m55.01938164s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588434223 (307h40m55.019514395s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588706314 (307h40m55.019786445s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588980499 (307h40m55.02006063s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589249422 (307h40m55.020329554s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589507317 (307h40m55.020587478s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589531773 (307h40m55.020611894s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589897242 (307h40m55.020977373s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590125078 (307h40m55.021205209s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590204410 (307h40m55.021284531s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590332385 (307h40m55.021412516s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590540673 (307h40m55.021620794s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590773820 (307h40m55.021853961s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591208391 (307h40m55.022288522s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591652842 (307h40m55.022732963s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592103483 (307h40m55.023183614s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592521354 (307h40m55.023601485s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.600360373 (307h40m55.031440504s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:01.743737381 (307h40m56.174817512s) [upload=320084]: Next returned nil segment
Aug 21 13:07:01.743760444 (307h40m56.174840575s) [upload=320084]: Waiting for error group managing segments...
Aug 21 13:07:02.034318641 (307h40m56.465398772s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.485347157 (307h40m56.916427288s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.524208433 (307h40m56.955288574s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.542337311 (307h40m56.973417442s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.552707754 (307h40m56.983787885s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.636957334 (307h40m57.068037465s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.656637741 (307h40m57.087717872s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.676220850 (307h40m57.107300981s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.700667776 (307h40m57.131747907s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.705226258 (307h40m57.136306379s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.757369869 (307h40m57.18845s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.780920480 (307h40m57.212000611s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.784900966 (307h40m57.215981097s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914499627 (307h40m57.345579758s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914526038 (307h40m57.345606159s) [seg_pos={0 0}, upload=320084]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:07:02.914694540 (307h40m57.345774671s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RvAMfdBV73d3kLZMSU3vQVSdv8Ef95eeYzrQeQAosYgZqF65k): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914797227 (307h40m57.345877358s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914833045 (307h40m57.345913166s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914893120 (307h40m57.345973251s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3SVXrhJsmYTXR4vDSkfaiqDRox21u17SLmQc9sEab1B7zZRr): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914908810 (307h40m57.345988941s) [seg_pos={0 0}, upload=320084]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:07:02.914972331 (307h40m57.346052462s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:07:02.914976831 (307h40m57.346056952s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:07:03.238105746 (307h40m57.669185878s) [upload=320084]: Done uploading segments...
Aug 21 13:07:03.238123691 (307h40m57.669203822s) [upload=320084]: Upload finished. err: <nil>
Duration: 6.426333932s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.980237862s
FAIL (2025-08-21 13:08:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.980268432s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........X...X..........................................XX..] duration:
8.210013824s
FAIL (2025-08-21 13:08:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 13:07:00.136945386 (307h40m54.568025527s) [upload=320084]: Starting upload
Aug 21 13:07:00.137011994 (307h40m54.568092145s) [upload=320084]: Done starting upload
Aug 21 13:07:00.137095163 (307h40m54.568175284s) [upload=320084]: Uploading segments...
Aug 21 13:07:00.137304974 (307h40m54.568385105s) [upload=320084]: Got next segment. Inline: false
Aug 21 13:07:00.137345672 (307h40m54.568425803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:07:00.137350672 (307h40m54.568430803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:07:00.588225794 (307h40m55.019305925s) [seg_pos={0 0}, upload=320084]: Begin upload segment...
Aug 21 13:07:00.588279717 (307h40m55.019359848s) [seg_pos={0 0}, upload=320084]: Done begin upload segment.
Aug 21 13:07:00.588301509 (307h40m55.01938164s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588434223 (307h40m55.019514395s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588706314 (307h40m55.019786445s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588980499 (307h40m55.02006063s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589249422 (307h40m55.020329554s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589507317 (307h40m55.020587478s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589531773 (307h40m55.020611894s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589897242 (307h40m55.020977373s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590125078 (307h40m55.021205209s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590204410 (307h40m55.021284531s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590332385 (307h40m55.021412516s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590540673 (307h40m55.021620794s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590773820 (307h40m55.021853961s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591208391 (307h40m55.022288522s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591652842 (307h40m55.022732963s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592103483 (307h40m55.023183614s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592521354 (307h40m55.023601485s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.600360373 (307h40m55.031440504s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:01.743737381 (307h40m56.174817512s) [upload=320084]: Next returned nil segment
Aug 21 13:07:01.743760444 (307h40m56.174840575s) [upload=320084]: Waiting for error group managing segments...
Aug 21 13:07:02.034318641 (307h40m56.465398772s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.485347157 (307h40m56.916427288s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.524208433 (307h40m56.955288574s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.542337311 (307h40m56.973417442s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.552707754 (307h40m56.983787885s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.636957334 (307h40m57.068037465s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.656637741 (307h40m57.087717872s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.676220850 (307h40m57.107300981s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.700667776 (307h40m57.131747907s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.705226258 (307h40m57.136306379s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.757369869 (307h40m57.18845s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.780920480 (307h40m57.212000611s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.784900966 (307h40m57.215981097s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914499627 (307h40m57.345579758s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914526038 (307h40m57.345606159s) [seg_pos={0 0}, upload=320084]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:07:02.914694540 (307h40m57.345774671s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RvAMfdBV73d3kLZMSU3vQVSdv8Ef95eeYzrQeQAosYgZqF65k): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914797227 (307h40m57.345877358s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914833045 (307h40m57.345913166s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914893120 (307h40m57.345973251s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3SVXrhJsmYTXR4vDSkfaiqDRox21u17SLmQc9sEab1B7zZRr): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914908810 (307h40m57.345988941s) [seg_pos={0 0}, upload=320084]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:07:02.914972331 (307h40m57.346052462s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:07:02.914976831 (307h40m57.346056952s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:07:03.238105746 (307h40m57.669185878s) [upload=320084]: Done uploading segments...
Aug 21 13:07:03.238123691 (307h40m57.669203822s) [upload=320084]: Upload finished. err: <nil>
Duration: 8.210043221s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........X...X..........................................XX.] duration:
6.591939376s
FAIL (2025-08-21 13:07:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 13:07:00.136945386 (307h40m54.568025527s) [upload=320084]: Starting upload
Aug 21 13:07:00.137011994 (307h40m54.568092145s) [upload=320084]: Done starting upload
Aug 21 13:07:00.137095163 (307h40m54.568175284s) [upload=320084]: Uploading segments...
Aug 21 13:07:00.137304974 (307h40m54.568385105s) [upload=320084]: Got next segment. Inline: false
Aug 21 13:07:00.137345672 (307h40m54.568425803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:07:00.137350672 (307h40m54.568430803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:07:00.588225794 (307h40m55.019305925s) [seg_pos={0 0}, upload=320084]: Begin upload segment...
Aug 21 13:07:00.588279717 (307h40m55.019359848s) [seg_pos={0 0}, upload=320084]: Done begin upload segment.
Aug 21 13:07:00.588301509 (307h40m55.01938164s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588434223 (307h40m55.019514395s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588706314 (307h40m55.019786445s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588980499 (307h40m55.02006063s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589249422 (307h40m55.020329554s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589507317 (307h40m55.020587478s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589531773 (307h40m55.020611894s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589897242 (307h40m55.020977373s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590125078 (307h40m55.021205209s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590204410 (307h40m55.021284531s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590332385 (307h40m55.021412516s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590540673 (307h40m55.021620794s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590773820 (307h40m55.021853961s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591208391 (307h40m55.022288522s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591652842 (307h40m55.022732963s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592103483 (307h40m55.023183614s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592521354 (307h40m55.023601485s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.600360373 (307h40m55.031440504s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:01.743737381 (307h40m56.174817512s) [upload=320084]: Next returned nil segment
Aug 21 13:07:01.743760444 (307h40m56.174840575s) [upload=320084]: Waiting for error group managing segments...
Aug 21 13:07:02.034318641 (307h40m56.465398772s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.485347157 (307h40m56.916427288s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.524208433 (307h40m56.955288574s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.542337311 (307h40m56.973417442s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.552707754 (307h40m56.983787885s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.636957334 (307h40m57.068037465s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.656637741 (307h40m57.087717872s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.676220850 (307h40m57.107300981s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.700667776 (307h40m57.131747907s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.705226258 (307h40m57.136306379s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.757369869 (307h40m57.18845s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.780920480 (307h40m57.212000611s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.784900966 (307h40m57.215981097s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914499627 (307h40m57.345579758s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914526038 (307h40m57.345606159s) [seg_pos={0 0}, upload=320084]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:07:02.914694540 (307h40m57.345774671s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RvAMfdBV73d3kLZMSU3vQVSdv8Ef95eeYzrQeQAosYgZqF65k): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914797227 (307h40m57.345877358s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914833045 (307h40m57.345913166s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914893120 (307h40m57.345973251s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3SVXrhJsmYTXR4vDSkfaiqDRox21u17SLmQc9sEab1B7zZRr): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914908810 (307h40m57.345988941s) [seg_pos={0 0}, upload=320084]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:07:02.914972331 (307h40m57.346052462s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:07:02.914976831 (307h40m57.346056952s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:07:03.238105746 (307h40m57.669185878s) [upload=320084]: Done uploading segments...
Aug 21 13:07:03.238123691 (307h40m57.669203822s) [upload=320084]: Upload finished. err: <nil>
Duration: 6.591963503s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.932070173s
FAIL (2025-08-21 13:07:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.932111772s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........X...X..........................................XX] duration:
4.210086193s
FAIL (2025-08-21 13:07:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 21 13:07:00.136945386 (307h40m54.568025527s) [upload=320084]: Starting upload
Aug 21 13:07:00.137011994 (307h40m54.568092145s) [upload=320084]: Done starting upload
Aug 21 13:07:00.137095163 (307h40m54.568175284s) [upload=320084]: Uploading segments...
Aug 21 13:07:00.137304974 (307h40m54.568385105s) [upload=320084]: Got next segment. Inline: false
Aug 21 13:07:00.137345672 (307h40m54.568425803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:07:00.137350672 (307h40m54.568430803s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:07:00.588225794 (307h40m55.019305925s) [seg_pos={0 0}, upload=320084]: Begin upload segment...
Aug 21 13:07:00.588279717 (307h40m55.019359848s) [seg_pos={0 0}, upload=320084]: Done begin upload segment.
Aug 21 13:07:00.588301509 (307h40m55.01938164s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588434223 (307h40m55.019514395s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588706314 (307h40m55.019786445s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.588980499 (307h40m55.02006063s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589249422 (307h40m55.020329554s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589507317 (307h40m55.020587478s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589531773 (307h40m55.020611894s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.589897242 (307h40m55.020977373s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590125078 (307h40m55.021205209s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590204410 (307h40m55.021284531s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590332385 (307h40m55.021412516s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590540673 (307h40m55.021620794s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.590773820 (307h40m55.021853961s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591208391 (307h40m55.022288522s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.591652842 (307h40m55.022732963s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592103483 (307h40m55.023183614s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.592521354 (307h40m55.023601485s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:00.600360373 (307h40m55.031440504s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Uploading piece...
Aug 21 13:07:01.743737381 (307h40m56.174817512s) [upload=320084]: Next returned nil segment
Aug 21 13:07:01.743760444 (307h40m56.174840575s) [upload=320084]: Waiting for error group managing segments...
Aug 21 13:07:02.034318641 (307h40m56.465398772s) [noise=true , address=79.127.205.246:4266 , piece_id=BROYX77NLZWOB66Y7JA2AHLPLVB7TJHFKETIEVSMI6FU44EGKPDQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.485347157 (307h40m56.916427288s) [noise=true , address=79.127.219.47:4056 , piece_id=J2H3MO6NP4SBBSNSPPGPHONAFPN34IH22QPRD4YWZBHJN6IBN2TQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.524208433 (307h40m56.955288574s) [noise=true , address=104.36.82.50:4014 , piece_id=PHLMK65FHMTU3ZR663D5IJFIXKRTHFWYDT5RIDHNBGMU6ZXPH3ZA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.542337311 (307h40m56.973417442s) [noise=true , address=104.36.82.5:4858 , piece_id=IVU2EYGLVG43GE6VUX5LFD3G2F4NJNQIM66N3G3ORCLNDCQ2EWBQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.552707754 (307h40m56.983787885s) [noise=true , address=77.90.31.19:4845 , piece_id=XCPRAMTA7BFVNBNHL3DHGBBFORO6NHPKF4XIABGQVHSDXXP47Z4A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.636957334 (307h40m57.068037465s) [noise=true , address=77.90.31.10:4522 , piece_id=62DC53BEXFL3I5LY7GA2YZXUJFHJU3HF6CTMSKQCKYYX3Z3QPDNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.656637741 (307h40m57.087717872s) [noise=true , address=77.90.31.13:4642 , piece_id=FRYAPTVO7EKAC7XBZ5VZ644F535TN5L42XJUFCB6RWP5NGLWHK5A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.676220850 (307h40m57.107300981s) [noise=true , address=104.36.82.23:4446 , piece_id=7NDOXAAIWO53NLCVIOANN2ZU3JDRSXQ3WMFT4X44IK733CEDQMPA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.700667776 (307h40m57.131747907s) [noise=true , address=79.127.201.214:4323 , piece_id=JVLXZN5IUXUBDPQQANLB5MDXSHVXAU3KWSMS2QZRGX34CBZJMFHA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.705226258 (307h40m57.136306379s) [noise=true , address=104.36.82.60:4343 , piece_id=2ESKE747T2WLRMW7MZ5MWHVSJIZGVBGWW4IWXKNCOQPV5CJNG2NA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.757369869 (307h40m57.18845s) [noise=true , address=45.91.116.6:4987 , piece_id=4FXQA7EGL7WQCWG6VTGGWCZEJV6HPTTQTTQBZVGLT6DFMUNDRZNQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.780920480 (307h40m57.212000611s) [noise=true , address=77.90.31.11:4587 , piece_id=XJ52XHOWDMMELJVO7LRLU6VPVGN7ZXJJ2AXWGBHFTRF4HB5TORHQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.784900966 (307h40m57.215981097s) [noise=true , address=77.90.31.16:4738 , piece_id=ACIXSSLCPAW5PTQOBEKTX4D3OOFI6N2JCLCDDORSNCB4NA7WFPQA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914499627 (307h40m57.345579758s) [noise=true , address=45.91.116.12:4238 , piece_id=5BCCGLD2H24N53EEE6U67EQKVHUGTKXJEIZSBZAEJXXMRO3E5KIA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: <nil>
Aug 21 13:07:02.914526038 (307h40m57.345606159s) [seg_pos={0 0}, upload=320084]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:07:02.914694540 (307h40m57.345774671s) [noise=true , address=79.127.219.48:4107 , piece_id=OR7FQVHHD6WXIJPCWIQOJQAP23IZAW55T3BY2PP7LUKH6JCWJ5MQ, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RvAMfdBV73d3kLZMSU3vQVSdv8Ef95eeYzrQeQAosYgZqF65k): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914797227 (307h40m57.345877358s) [noise=true , address=45.91.116.11:4126 , piece_id=RE4PY4AJJMPMBRTP4WR3TVP3NQWLLCDHW4CHPDUOLEHZJJ6OPRSA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PV6YT6Xdr61PcyNzJsocXBh2NTMtfpqDT9DX49QGi5EiKATJF): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914833045 (307h40m57.345913166s) [noise=true , address=104.36.82.44:4880 , piece_id=WAYXSZWLGCQKWPUOU2KUR5YXAISB2CQQ43Q4PJKMY3ZX5QDMJD2A, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914893120 (307h40m57.345973251s) [noise=true , address=104.36.82.11:4126 , piece_id=RARVMAK2P44FN4K4EJBN2ROYIL3V3SY3TVAEKWOPSV35VXO44ZJA, seg_pos={0 0}, upload=320084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12R3SVXrhJsmYTXR4vDSkfaiqDRox21u17SLmQc9sEab1B7zZRr): protocol: expected piece hash; context canceled; EOF
Aug 21 13:07:02.914908810 (307h40m57.345988941s) [seg_pos={0 0}, upload=320084]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:07:02.914972331 (307h40m57.346052462s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:07:02.914976831 (307h40m57.346056952s) [upload=320084]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:07:03.238105746 (307h40m57.669185878s) [upload=320084]: Done uploading segments...
Aug 21 13:07:03.238123691 (307h40m57.669203822s) [upload=320084]: Upload finished. err: <nil>
Duration: 4.210120126s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.018991153s
FAIL (2025-08-21 13:06:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.019025979s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X...X..........................................X] duration:
6.033645038s
FAIL (2025-08-21 13:06:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after a01952095eef6714b4b401b26bf7bf041e35f7879f54c40927b4428b9819594d != before a559a283f8db777c9c6ad274eac63c233b665c9b3b9f6e1892928477996d40a8
======LOGS======
Aug 21 13:06:18.517163750 (307h40m12.948243881s) [upload=320074]: Starting upload
Aug 21 13:06:18.517236810 (307h40m12.948316941s) [upload=320074]: Done starting upload
Aug 21 13:06:18.517390794 (307h40m12.948470945s) [upload=320074]: Uploading segments...
Aug 21 13:06:18.517527446 (307h40m12.948607587s) [upload=320074]: Got next segment. Inline: false
Aug 21 13:06:18.517603702 (307h40m12.948683843s) [upload=320074]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 13:06:18.517610294 (307h40m12.948690425s) [upload=320074]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 13:06:18.980167019 (307h40m13.41124715s) [seg_pos={0 0}, upload=320074]: Begin upload segment...
Aug 21 13:06:18.980210262 (307h40m13.411290394s) [seg_pos={0 0}, upload=320074]: Done begin upload segment.
Aug 21 13:06:18.980231913 (307h40m13.411312034s) [noise=true , address=104.36.82.23:4460 , piece_id=2M76ZB4JKKSFVKEWGCJQW4HLHUHL6BUHKUTRLDYA3ML5VANFV6CQ, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.980349639 (307h40m13.41142979s) [noise=true , address=104.36.82.5:4844 , piece_id=OSKPEIBNO7XD3GUXRAIQLIURSWYU7BUGHTRQ6IZSRFBPTJO56MNQ, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.980766206 (307h40m13.411846337s) [noise=true , address=77.90.31.21:4905 , piece_id=5SOLNC4IIJYQ66KNAWOH4IYTNEX53K6IWQGEKSRU37RO42UYH5EA, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.981101628 (307h40m13.412181759s) [noise=true , address=79.127.219.51:4213 , piece_id=6ACCQHVUYCGDEL6HPAQTWUUB6YOU7MMM6T5UVKYO5RIQ2EHOWBRQ, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.981382855 (307h40m13.412462986s) [noise=true , address=104.36.82.51:4051 , piece_id=U55DMYWLJE2RPI6EIGWO6NGMRPISHZEZWBGXBKSRJ5RHNU7P6CWA, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.981492675 (307h40m13.412572807s) [noise=true , address=77.90.31.19:4863 , piece_id=3PSMBHIUOJQTXBD4LRAF4K7JQZ22A26KFC5QOVDAS2OQB4PQ5USQ, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.981700403 (307h40m13.412780534s) [noise=true , address=104.36.82.44:4884 , piece_id=IVE2PXQPOTDXVZB5R7KOK5LVZ6NKVECVGPXEAO6OGV5JPK2WKZ3Q, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.981903872 (307h40m13.412984003s) [noise=true , address=104.36.82.12:4154 , piece_id=OIIGIJOHCAIMD2XZ77UBSIBBHLYSTWIJP2VKNHSR7U4VBFZ67S7Q, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.982121719 (307h40m13.41320185s) [noise=true , address=77.90.31.18:4836 , piece_id=DQFBTO27JP2ZYX4U2NCN6G4G3W7MAOEH3OIEH35CFHVPK262JP7A, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.982222072 (307h40m13.413302203s) [noise=true , address=77.90.31.13:4657 , piece_id=5JZV6NUCZPRZKQLGQEJYMYGB627E4RXDKFNL6QWD7AO7JFK4GAYQ, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.982450047 (307h40m13.413530168s) [noise=true , address=79.127.205.246:4281 , piece_id=FPBEJ6ACUUPMLYFHZ7T7DQNOBJDS3R6HQCQ7AJIUJG6AYA44CWFA, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.982531253 (307h40m13.413611384s) [noise=true , address=104.36.82.60:4364 , piece_id=LK3HKZFQR6PKPUS3AZGUXWYFDDMZ2WHK6FHTO5H4B7OJVBI5IZIA, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.982724563 (307h40m13.413804694s) [noise=true , address=79.127.219.47:4055 , piece_id=OPFZNDI75WEMFGEI2ZQO4LMZBNR6UJGASYB7ABIS2BVWXAEK5M6Q, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.982834633 (307h40m13.413914754s) [noise=true , address=45.91.116.8:4046 , piece_id=L2CKOMZICHVI2HIOLEVN5KBS2UGRL7XYEUR5XVZXCDII6MD3RY5A, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.982965684 (307h40m13.414045825s) [noise=true , address=77.90.31.17:4782 , piece_id=LPVJYYRFS7ZVUBSYZZDS2KZL56YTVW75ISHDZILIV4OOPHQMGJNQ, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.983102526 (307h40m13.414182657s) [noise=true , address=77.90.31.10:4551 , piece_id=P2NDWIDFHAIZV6YHD2D346BJ2WILWB2I36PAWP3CDBDC6AZIAYFQ, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.983187018 (307h40m13.414267149s) [noise=true , address=77.90.31.16:4753 , piece_id=YJBZKJWIEBWFMKGVK65SO5WJ2ZOH73KOND4I7IJQRVK5LFH6HXLA, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:18.983361992 (307h40m13.414442123s) [noise=true , address=45.91.116.9:4278 , piece_id=Z475HVBZMM3UXH5RN2HZEVAPGO32HNT47WYOYEOQ2UGOZTAE4R5A, seg_pos={0 0}, upload=320074]: Uploading piece...
Aug 21 13:06:20.133697904 (307h40m14.564778025s) [upload=320074]: Next returned nil segment
Aug 21 13:06:20.133715088 (307h40m14.564795219s) [upload=320074]: Waiting for error group managing segments...
Aug 21 13:06:20.427292880 (307h40m14.858373011s) [noise=true , address=79.127.205.246:4281 , piece_id=FPBEJ6ACUUPMLYFHZ7T7DQNOBJDS3R6HQCQ7AJIUJG6AYA44CWFA, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:20.849938249 (307h40m15.28101838s) [noise=true , address=79.127.219.47:4055 , piece_id=OPFZNDI75WEMFGEI2ZQO4LMZBNR6UJGASYB7ABIS2BVWXAEK5M6Q, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:20.910875645 (307h40m15.341955796s) [noise=true , address=77.90.31.21:4905 , piece_id=5SOLNC4IIJYQ66KNAWOH4IYTNEX53K6IWQGEKSRU37RO42UYH5EA, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:20.917601625 (307h40m15.348681746s) [noise=true , address=45.91.116.8:4046 , piece_id=L2CKOMZICHVI2HIOLEVN5KBS2UGRL7XYEUR5XVZXCDII6MD3RY5A, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:20.936434569 (307h40m15.3675147s) [noise=true , address=77.90.31.17:4782 , piece_id=LPVJYYRFS7ZVUBSYZZDS2KZL56YTVW75ISHDZILIV4OOPHQMGJNQ, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:20.939783136 (307h40m15.370863267s) [noise=true , address=77.90.31.10:4551 , piece_id=P2NDWIDFHAIZV6YHD2D346BJ2WILWB2I36PAWP3CDBDC6AZIAYFQ, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:20.956891129 (307h40m15.387971272s) [noise=true , address=79.127.219.51:4213 , piece_id=6ACCQHVUYCGDEL6HPAQTWUUB6YOU7MMM6T5UVKYO5RIQ2EHOWBRQ, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:20.967195436 (307h40m15.398275567s) [noise=true , address=77.90.31.13:4657 , piece_id=5JZV6NUCZPRZKQLGQEJYMYGB627E4RXDKFNL6QWD7AO7JFK4GAYQ, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:20.978591811 (307h40m15.409671932s) [noise=true , address=77.90.31.19:4863 , piece_id=3PSMBHIUOJQTXBD4LRAF4K7JQZ22A26KFC5QOVDAS2OQB4PQ5USQ, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:20.995556831 (307h40m15.426636962s) [noise=true , address=104.36.82.12:4154 , piece_id=OIIGIJOHCAIMD2XZ77UBSIBBHLYSTWIJP2VKNHSR7U4VBFZ67S7Q, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:21.002444641 (307h40m15.433524782s) [noise=true , address=104.36.82.51:4051 , piece_id=U55DMYWLJE2RPI6EIGWO6NGMRPISHZEZWBGXBKSRJ5RHNU7P6CWA, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:21.013115258 (307h40m15.444195409s) [noise=true , address=77.90.31.18:4836 , piece_id=DQFBTO27JP2ZYX4U2NCN6G4G3W7MAOEH3OIEH35CFHVPK262JP7A, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:21.061543389 (307h40m15.49262351s) [noise=true , address=77.90.31.16:4753 , piece_id=YJBZKJWIEBWFMKGVK65SO5WJ2ZOH73KOND4I7IJQRVK5LFH6HXLA, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:21.099076844 (307h40m15.530156975s) [noise=true , address=104.36.82.44:4884 , piece_id=IVE2PXQPOTDXVZB5R7KOK5LVZ6NKVECVGPXEAO6OGV5JPK2WKZ3Q, seg_pos={0 0}, upload=320074]: Done uploading piece. err: <nil>
Aug 21 13:06:21.099103355 (307h40m15.530183486s) [seg_pos={0 0}, upload=320074]: Segment reached optimal threshold of 14 pieces.
Aug 21 13:06:21.099315671 (307h40m15.530395803s) [noise=true , address=104.36.82.23:4460 , piece_id=2M76ZB4JKKSFVKEWGCJQW4HLHUHL6BUHKUTRLDYA3ML5VANFV6CQ, seg_pos={0 0}, upload=320074]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12PSoJT12SgP3n6ysTLMg1XwcdQmbqCPZYijha97LFC3LucEpFn): protocol: expected piece hash; context canceled; EOF
Aug 21 13:06:21.099378471 (307h40m15.530458602s) [noise=true , address=104.36.82.60:4364 , piece_id=LK3HKZFQR6PKPUS3AZGUXWYFDDMZ2WHK6FHTO5H4B7OJVBI5IZIA, seg_pos={0 0}, upload=320074]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12S9DQZhV6SDULbA9WKndh12CpFih6xtNcpdwUApD9d2XThFdFk): protocol: expected piece hash; context canceled; EOF
Aug 21 13:06:21.099410162 (307h40m15.530490293s) [noise=true , address=45.91.116.9:4278 , piece_id=Z475HVBZMM3UXH5RN2HZEVAPGO32HNT47WYOYEOQ2UGOZTAE4R5A, seg_pos={0 0}, upload=320074]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:43950->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:43950->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43950->45.91.116.9:4278: use of closed network connection
Aug 21 13:06:21.099467121 (307h40m15.530547252s) [noise=true , address=104.36.82.5:4844 , piece_id=OSKPEIBNO7XD3GUXRAIQLIURSWYU7BUGHTRQ6IZSRFBPTJO56MNQ, seg_pos={0 0}, upload=320074]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: write tcp 188.166.225.170:47322->104.36.82.5:4844: use of closed network connection; write tcp 188.166.225.170:47322->104.36.82.5:4844: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:47322->104.36.82.5:4844: use of closed network connection
Aug 21 13:06:21.099485336 (307h40m15.530565467s) [seg_pos={0 0}, upload=320074]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 13:06:21.099540692 (307h40m15.530620823s) [upload=320074]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 13:06:21.099544479 (307h40m15.5306246s) [upload=320074]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 13:06:21.414327678 (307h40m15.845407809s) [upload=320074]: Done uploading segments...
Aug 21 13:06:21.414347245 (307h40m15.845427376s) [upload=320074]: Upload finished. err: <nil>
Duration: 6.033672228s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.225484736s
FAIL (2025-08-21 13:06:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.225524232s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X...X..........................................] duration:
5.898248941s
FAIL (2025-08-21 13:05:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.898268189s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X...X.........................................] duration:
5.913070111s
FAIL (2025-08-21 13:05:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.913098514s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.936995198s
FAIL (2025-08-21 13:05:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.937018142s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X...X........................................] duration:
6.003451821s
FAIL (2025-08-21 13:04:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.003474824s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X...X.......................................] duration:
5.891164737s
FAIL (2025-08-21 13:04:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.891187731s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X...X......................................] duration:
5.9558496s
FAIL (2025-08-21 13:03:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.955885029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.950830129s
FAIL (2025-08-21 13:03:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.950857773s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X...X.....................................] duration:
6.131992805s
FAIL (2025-08-21 13:02:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.132017362s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.09373516s
FAIL (2025-08-21 13:02:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.093765147s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.955810126s
FAIL (2025-08-21 13:01:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.955835635s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X...X....................................] duration:
6.169610095s
FAIL (2025-08-21 13:01:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.169629123s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X...X...................................] duration:
6.05573137s
FAIL (2025-08-21 13:01:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.055747361s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.961176054s
FAIL (2025-08-21 13:01:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.961208936s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X...X..................................] duration:
6.332541419s
FAIL (2025-08-21 13:00:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.332564353s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X...X.................................] duration:
6.395631458s
FAIL (2025-08-21 13:00:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.395666155s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X............................................X..............] duration:
2.974643026s
FAIL (2025-08-21 12:59:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.974676261s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X...X................................] duration:
6.23110348s
FAIL (2025-08-21 12:59:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.231130583s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X............................................X.............] duration:
3.20966429s
FAIL (2025-08-21 12:59:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:48:41.089688866 (307h22m35.520768997s) [upload=319774]: Starting upload Aug 21 12:48:41.089752028 (307h22m35.520832159s) [upload=319774]: Done starting upload Aug 21 12:48:41.089830188 (307h22m35.520910319s) [upload=319774]: Uploading segments... Aug 21 12:48:41.089915751 (307h22m35.520995882s) [upload=319774]: Got next segment. Inline: true Aug 21 12:48:41.089920129 (307h22m35.521000261s) [upload=319774]: Waiting for error group managing segments... Aug 21 12:48:41.089970797 (307h22m35.521050918s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:48:41.089976046 (307h22m35.521056177s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 12:48:41.089978651 (307h22m35.521058782s) [upload=319774]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 12:48:41.302830648 (307h22m35.733910769s) [upload=319774]: Done uploading segments... Aug 21 12:48:41.302848672 (307h22m35.733928803s) [upload=319774]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.209694499s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X...X...............................] duration:
8.111104038s
FAIL (2025-08-21 12:59:23 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 8.111130318s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X...X..............................] duration:
6.443785488s
FAIL (2025-08-21 12:58:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 12:37:32.011633554 (307h11m26.442713675s) [upload=319575]: Starting upload Aug 21 12:37:32.011685143 (307h11m26.442765274s) [upload=319575]: Done starting upload Aug 21 12:37:32.011788431 (307h11m26.442868562s) [upload=319575]: Uploading segments... Aug 21 12:37:32.011908640 (307h11m26.442988771s) [upload=319575]: Got next segment. Inline: false Aug 21 12:37:32.011943137 (307h11m26.443023268s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 12:37:32.011948948 (307h11m26.443029079s) [upload=319575]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 12:37:32.230845870 (307h11m26.661926001s) [upload=319575]: Next segment err: metaclient: Too Many Requests Aug 21 12:37:32.230868433 (307h11m26.661948564s) [upload=319575]: Done uploading segments... Aug 21 12:37:32.230883442 (307h11m26.661963563s) [upload=319575]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.443815777s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|