Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.067855357s FAIL (2025-08-07 16:48:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.067884593s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X............X...............] duration: 5.798948333s FAIL (2025-08-07 16:48:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 5.798974674s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.854570104s FAIL (2025-08-07 16:48:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.854610651s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X............X..............] duration: 5.949057343s FAIL (2025-08-07 16:47:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 5.949078385s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X............X.............] duration: 6.168353738s FAIL (2025-08-07 16:47:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 6.168376131s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X......................................X....................] duration: 2.022210156s FAIL (2025-08-07 16:46:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.022234381s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X............X............] duration: 5.981099572s FAIL (2025-08-07 16:46:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 5.981133037s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X......................................X...................] duration: 1.957613343s FAIL (2025-08-07 16:46:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.9576378s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X............X...........] duration: 6.125527202s FAIL (2025-08-07 16:45:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 6.125545918s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X......................................X..................] duration: 2.894428879s FAIL (2025-08-07 16:45:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.894465379s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X...................................X............X..........] duration: 5.766418985s FAIL (2025-08-07 16:45:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 5.766447199s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X...................................X............X.........] duration: 5.957901295s FAIL (2025-08-07 16:44:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 5.957931864s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X......................................X.................] duration: 1.901056805s FAIL (2025-08-07 16:44:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.901082263s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...................................X............X........] duration: 5.661602511s FAIL (2025-08-07 16:44:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 5.661630545s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X......................................X................] duration: 1.9456215s FAIL (2025-08-07 16:43:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.945636558s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X...................................X............X.......] duration: 5.671872309s FAIL (2025-08-07 16:43:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 5.671895504s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X......................................X...............] duration: 2.390420837s FAIL (2025-08-07 16:42:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.390449582s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...................................X............X......] duration: 5.830074755s FAIL (2025-08-07 16:42:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 5.830101686s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X......................................X..............] duration: 2.035225819s FAIL (2025-08-07 16:42:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.035251467s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X......................................X.............] duration: 2.040135563s FAIL (2025-08-07 16:41:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.040162553s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X...................................X............X.....] duration: 6.062857279s FAIL (2025-08-07 16:41:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 6.062887137s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...................................X............X....] duration: 5.514582326s FAIL (2025-08-07 16:41:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 5.514608086s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X......................................X............] duration: 1.823021462s FAIL (2025-08-07 16:40:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.823062049s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X...................................X............X...] duration: 6.012573636s FAIL (2025-08-07 16:39:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 6.012597832s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X......................................X...........] duration: 2.167226855s FAIL (2025-08-07 16:39:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.167277823s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.......X...................................X............X..] duration: 5.54678106s FAIL (2025-08-07 16:39:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 5.546804807s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X......................................X..........] duration: 1.838549524s FAIL (2025-08-07 16:39:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.838572356s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X.......X...................................X............X.] duration: 5.931525024s FAIL (2025-08-07 16:39:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 5.931549412s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X......................................X.........] duration: 1.826754555s FAIL (2025-08-07 16:38:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.826782529s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.......X...................................X............X] duration: 853.621568ms FAIL (2025-08-07 16:38:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e begin upload segment. Aug 7 16:37:12.725588907 (6h57m12.314933884s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725616580 (6h57m12.314961567s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.725942442 (6h57m12.31528743s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726061200 (6h57m12.315406187s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726210135 (6h57m12.315555122s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726377485 (6h57m12.315722472s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726444864 (6h57m12.315789851s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726675255 (6h57m12.316020242s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726699982 (6h57m12.316044999s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.726975209 (6h57m12.316320186s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727049531 (6h57m12.316394518s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727241528 (6h57m12.316586516s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727265374 (6h57m12.316610361s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727501826 (6h57m12.316846813s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727512006 (6h57m12.316856993s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727728940 (6h57m12.317073927s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.727762626 (6h57m12.317107613s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:12.729312681 (6h57m12.318657658s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Uploading piece... Aug 7 16:37:13.839807840 (6h57m13.429152827s) [upload=7235]: Next returned nil segment Aug 7 16:37:13.839819212 (6h57m13.429164199s) [upload=7235]: Waiting for error group managing segments... Aug 7 16:37:14.141501876 (6h57m13.730846863s) [noise=true , address=193.149.164.143:4700 , piece_id=CWM2KI7NOT4KIQRTF5DCJJUDGDHJ5J67CVNACZY34YHSM5JLFT5Q, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.154530513 (6h57m13.7438755s) [noise=true , address=79.127.205.233:4624 , piece_id=4AM6KEPYHBH5P2UKC2OSMLU354P3MEBNPS2COUML2U4TJJOZEHQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.189611183 (6h57m13.77895617s) [noise=true , address=64.49.13.155:4924 , piece_id=QX2TNSR4T7Z7DVD7ABTSPSCV5B6F36XWTDODXQ46AQ3VM4KRO2YQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.624400907 (6h57m14.213745894s) [noise=true , address=104.36.82.4:4810 , piece_id=6V6AKEFJ7QSJGKYW7DBRTCO65OKQZ2IPOP445WCU2N6R5WQ3WYMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.662759559 (6h57m14.252104546s) [noise=true , address=79.127.201.215:4347 , piece_id=TXQ4HBPPT7HL5PVUFSLAAXJRGRW4Q7CLGRYBIBYV3QPA5JDKSXQA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.679892799 (6h57m14.269237786s) [noise=true , address=104.36.82.46:4491 , piece_id=BIKNDL3VU4FZUBORHC77QAZ7JKETRAKYWHEJSHFGCLP4P6TYM7ZQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.684417537 (6h57m14.273762524s) [noise=true , address=104.36.82.37:4685 , piece_id=AMC6UMNWUTQT6MYOJKAYZLKC4NE5GE7B6AFQ6VT5FNNDFMHGM7TA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.715443538 (6h57m14.304788525s) [noise=true , address=45.91.116.6:4006 , piece_id=CFGGSL4ZWDUL5VWN7R65KZR4TYFXHZ7KYVFVXUJJW2ZR62SNNWUQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.723422023 (6h57m14.31276701s) [noise=true , address=104.36.82.15:4284 , piece_id=AU6Q224IRDAQAN4NMKVRBWJNT4WBNYXML346YZHKSEK5H6R5RXEA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736696581 (6h57m14.326041568s) [noise=true , address=77.90.31.11:4569 , piece_id=5F6IZDAFNUAKF4WGPIR5O67GCMTCIHHHTF6GSQJSFVO4D6MSLREA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.736895701 (6h57m14.326240688s) [noise=true , address=104.36.82.47:4545 , piece_id=CHURFMNOQYBQ6Y6BJUKISOW6Y4IHSYXOPC5CNJYNTP5QO4LXWRMQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.745370257 (6h57m14.334715244s) [noise=true , address=104.36.82.61:4375 , piece_id=HJWIGFWBJE7V7ZVBE36YOV3LV3TUYNUXXDVWOXZS5BKH4DN34JPQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751324017 (6h57m14.340668994s) [noise=true , address=104.36.82.62:4426 , piece_id=NFP6KYSHWEWMQSJAC5AFCIDMMLZVAISHC4S2XI3LLVNNNO3JVROQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751936279 (6h57m14.341281266s) [noise=true , address=104.36.82.23:4450 , piece_id=VDL66ISNVS6POUQPYJ762DZXOHVSUKDSP7KYB22JY6FHY6J3THYA, seg_pos={0 0}, upload=7235]: Done uploading piece. err: <nil> Aug 7 16:37:14.751956498 (6h57m14.341301475s) [seg_pos={0 0}, upload=7235]: Segment reached optimal threshold of 14 pieces. Aug 7 16:37:14.752102476 (6h57m14.341447464s) [noise=true , address=104.36.82.59:4318 , piece_id=TGRUBU5HFNMMWXWE45J2DWYGBZ3USWLMUNRPXJLDKK72ZF3CUI5A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12abkQbak5f8FneYvCZo5FVi4RNZZfijQZFDd4Y1aacLUNgLnyM): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752112156 (6h57m14.341457143s) [noise=true , address=104.36.82.35:4614 , piece_id=AUVJDGRD26V35TEERKFA5PL5A2NZWW6TF46EXTRV3ZCHVXZXMKLQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Pua5x8rAsuqYWCgoAY6fgy2SXNoDjzt7WwgMhzv1HN2KG5NY4): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752184413 (6h57m14.3415294s) [noise=true , address=104.36.82.9:4009 , piece_id=7LX4WAX77UTK3BW3LJVHP5DKUEBLKMHZYOCM2S6IQCY54YZTQM3A, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12n33Xie5Hk1vaKc279HvGnL2QBEYsNzieL2grpnANJpy7Qu2wb): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752204362 (6h57m14.341549339s) [noise=true , address=104.36.82.52:4094 , piece_id=5COVVASIV62GCZTBSZFWP2NYMCQXFQEWSHMQWUKFWFK36FGKIJIQ, seg_pos={0 0}, upload=7235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QYpeobqZ5QtLcuNBh9fHhiKxnbEtpiAaagvgWyTZvGbgbFxH7): protocol: expected piece hash; context canceled; EOF Aug 7 16:37:14.752222407 (6h57m14.341567394s) [seg_pos={0 0}, upload=7235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:37:14.752288242 (6h57m14.341633219s) [upload=7235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:37:14.752292160 (6h57m14.341637147s) [upload=7235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:15.081373424 (6h57m14.670718412s) [upload=7235]: Done uploading segments... Aug 7 16:37:15.081393744 (6h57m14.670738731s) [upload=7235]: Upload finished. err: <nil> Aug 7 16:38:15.732265245 (6h58m15.321610252s) [upload=7253]: Starting upload Aug 7 16:38:15.732359776 (6h58m15.321704814s) [upload=7253]: Done starting upload Aug 7 16:38:15.732412106 (6h58m15.321757113s) [upload=7253]: Uploading segments... Aug 7 16:38:15.732676131 (6h58m15.322021128s) [upload=7253]: Got next segment. Inline: false Aug 7 16:38:15.732706149 (6h58m15.322051146s) [upload=7253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:15.733148886 (6h58m15.322493883s) [upload=7253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:38:15.945172838 (6h58m15.534517825s) [upload=7253]: Next segment err: metaclient: Too Many Requests Aug 7 16:38:15.945196343 (6h58m15.53454133s) [upload=7253]: Done uploading segments... Aug 7 16:38:15.945212284 (6h58m15.534557271s) [upload=7253]: Upload finished. err: metaclient: Too Many Requests Duration: 853.640485ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X......................................X........] duration: 1.890407982s FAIL (2025-08-07 16:37:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.890426087s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X.......X...................................X............] duration: 5.716692939s FAIL (2025-08-07 16:37:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3e968f3b95e0e02f307788724450fb32a5d2284f38be5ee817bb0100ee22b248 != before 4fe9b70d0b55d0afbe895ee53653b05d749598940dfe207bcb28a92d85144b3f ======LOGS====== 7 16:27:38.960521720 (6h47m38.549866707s) [upload=7062]: Done uploading segments... Aug 7 16:27:38.960539725 (6h47m38.549884712s) [upload=7062]: Upload finished. err: <nil> Aug 7 16:27:59.944544572 (6h47m59.533889549s) [upload=7067]: Starting upload Aug 7 16:27:59.944582163 (6h47m59.53392714s) [upload=7067]: Done starting upload Aug 7 16:27:59.944891205 (6h47m59.534236192s) [upload=7067]: Uploading segments... Aug 7 16:27:59.944925591 (6h47m59.534270568s) [upload=7067]: Got next segment. Inline: false Aug 7 16:27:59.944991657 (6h47m59.534336644s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:59.944995945 (6h47m59.534340932s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:28:00.449006469 (6h48m0.038351456s) [seg_pos={0 0}, upload=7067]: Begin upload segment... Aug 7 16:28:00.449052597 (6h48m0.038397574s) [seg_pos={0 0}, upload=7067]: Done begin upload segment. Aug 7 16:28:00.449087645 (6h48m0.038432632s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449126939 (6h48m0.038471926s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449467651 (6h48m0.038812638s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449732658 (6h48m0.039077645s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450012964 (6h48m0.039357951s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450102565 (6h48m0.039447553s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450441034 (6h48m0.039786021s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450710019 (6h48m0.040055006s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450750986 (6h48m0.040095974s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450960678 (6h48m0.040305695s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451004181 (6h48m0.040349168s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451215155 (6h48m0.040560132s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451409927 (6h48m0.040754914s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451615601 (6h48m0.040960588s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451729780 (6h48m0.041074767s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451962965 (6h48m0.041307952s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452160283 (6h48m0.04150527s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452384061 (6h48m0.041729048s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:01.571755435 (6h48m1.161100432s) [upload=7067]: Next returned nil segment Aug 7 16:28:01.571780853 (6h48m1.16112584s) [upload=7067]: Waiting for error group managing segments... Aug 7 16:28:01.882050877 (6h48m1.471395864s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.336868791 (6h48m1.926213778s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.361083941 (6h48m1.950428928s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.368873195 (6h48m1.958218182s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.370847201 (6h48m1.960192188s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.379776847 (6h48m1.969121834s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.380397114 (6h48m1.969742101s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.385457646 (6h48m1.974802633s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.412154514 (6h48m2.001499501s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.448097673 (6h48m2.03744266s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.455094621 (6h48m2.044439608s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.466113062 (6h48m2.055458049s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.467618803 (6h48m2.05696378s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505183364 (6h48m2.094528351s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505208252 (6h48m2.094553239s) [seg_pos={0 0}, upload=7067]: Segment reached optimal threshold of 14 pieces. Aug 7 16:28:02.505325958 (6h48m2.094670945s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126SqCtRGPziEeopRjA4nNkjkCZWvUwkt5XaMgcqZKJwoxuYWY7): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505385191 (6h48m2.094730178s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127dfR4NEArFbQQDa7f7C2fWeKDzeEut9nhLogdG5aZk84FxXtL): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505435848 (6h48m2.094780835s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505520660 (6h48m2.094865647s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FkuTqtaF3DmzHFvcCuJRvaubQV6HbaV1CnFtoY95QHH6NcME): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505565525 (6h48m2.094910512s) [seg_pos={0 0}, upload=7067]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:28:02.505648183 (6h48m2.094993171s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:28:02.505652633 (6h48m2.09499762s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:02.808812342 (6h48m2.398157329s) [upload=7067]: Done uploading segments... Aug 7 16:28:02.808842760 (6h48m2.398187787s) [upload=7067]: Upload finished. err: <nil> Duration: 5.716716135s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X......................................X.......] duration: 1.886525595s FAIL (2025-08-07 16:36:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.886559882s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X.......X...................................X...........] duration: 6.12698335s FAIL (2025-08-07 16:36:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3e968f3b95e0e02f307788724450fb32a5d2284f38be5ee817bb0100ee22b248 != before 4fe9b70d0b55d0afbe895ee53653b05d749598940dfe207bcb28a92d85144b3f ======LOGS====== 7 16:27:38.960521720 (6h47m38.549866707s) [upload=7062]: Done uploading segments... Aug 7 16:27:38.960539725 (6h47m38.549884712s) [upload=7062]: Upload finished. err: <nil> Aug 7 16:27:59.944544572 (6h47m59.533889549s) [upload=7067]: Starting upload Aug 7 16:27:59.944582163 (6h47m59.53392714s) [upload=7067]: Done starting upload Aug 7 16:27:59.944891205 (6h47m59.534236192s) [upload=7067]: Uploading segments... Aug 7 16:27:59.944925591 (6h47m59.534270568s) [upload=7067]: Got next segment. Inline: false Aug 7 16:27:59.944991657 (6h47m59.534336644s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:59.944995945 (6h47m59.534340932s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:28:00.449006469 (6h48m0.038351456s) [seg_pos={0 0}, upload=7067]: Begin upload segment... Aug 7 16:28:00.449052597 (6h48m0.038397574s) [seg_pos={0 0}, upload=7067]: Done begin upload segment. Aug 7 16:28:00.449087645 (6h48m0.038432632s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449126939 (6h48m0.038471926s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449467651 (6h48m0.038812638s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449732658 (6h48m0.039077645s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450012964 (6h48m0.039357951s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450102565 (6h48m0.039447553s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450441034 (6h48m0.039786021s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450710019 (6h48m0.040055006s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450750986 (6h48m0.040095974s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450960678 (6h48m0.040305695s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451004181 (6h48m0.040349168s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451215155 (6h48m0.040560132s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451409927 (6h48m0.040754914s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451615601 (6h48m0.040960588s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451729780 (6h48m0.041074767s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451962965 (6h48m0.041307952s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452160283 (6h48m0.04150527s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452384061 (6h48m0.041729048s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:01.571755435 (6h48m1.161100432s) [upload=7067]: Next returned nil segment Aug 7 16:28:01.571780853 (6h48m1.16112584s) [upload=7067]: Waiting for error group managing segments... Aug 7 16:28:01.882050877 (6h48m1.471395864s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.336868791 (6h48m1.926213778s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.361083941 (6h48m1.950428928s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.368873195 (6h48m1.958218182s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.370847201 (6h48m1.960192188s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.379776847 (6h48m1.969121834s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.380397114 (6h48m1.969742101s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.385457646 (6h48m1.974802633s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.412154514 (6h48m2.001499501s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.448097673 (6h48m2.03744266s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.455094621 (6h48m2.044439608s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.466113062 (6h48m2.055458049s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.467618803 (6h48m2.05696378s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505183364 (6h48m2.094528351s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505208252 (6h48m2.094553239s) [seg_pos={0 0}, upload=7067]: Segment reached optimal threshold of 14 pieces. Aug 7 16:28:02.505325958 (6h48m2.094670945s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126SqCtRGPziEeopRjA4nNkjkCZWvUwkt5XaMgcqZKJwoxuYWY7): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505385191 (6h48m2.094730178s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127dfR4NEArFbQQDa7f7C2fWeKDzeEut9nhLogdG5aZk84FxXtL): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505435848 (6h48m2.094780835s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505520660 (6h48m2.094865647s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FkuTqtaF3DmzHFvcCuJRvaubQV6HbaV1CnFtoY95QHH6NcME): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505565525 (6h48m2.094910512s) [seg_pos={0 0}, upload=7067]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:28:02.505648183 (6h48m2.094993171s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:28:02.505652633 (6h48m2.09499762s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:02.808812342 (6h48m2.398157329s) [upload=7067]: Done uploading segments... Aug 7 16:28:02.808842760 (6h48m2.398187787s) [upload=7067]: Upload finished. err: <nil> Duration: 6.127010101s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X......................................X......] duration: 1.826654173s FAIL (2025-08-07 16:35:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.826678959s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X.......X...................................X..........] duration: 6.137326613s FAIL (2025-08-07 16:35:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3e968f3b95e0e02f307788724450fb32a5d2284f38be5ee817bb0100ee22b248 != before 4fe9b70d0b55d0afbe895ee53653b05d749598940dfe207bcb28a92d85144b3f ======LOGS====== 7 16:27:38.960521720 (6h47m38.549866707s) [upload=7062]: Done uploading segments... Aug 7 16:27:38.960539725 (6h47m38.549884712s) [upload=7062]: Upload finished. err: <nil> Aug 7 16:27:59.944544572 (6h47m59.533889549s) [upload=7067]: Starting upload Aug 7 16:27:59.944582163 (6h47m59.53392714s) [upload=7067]: Done starting upload Aug 7 16:27:59.944891205 (6h47m59.534236192s) [upload=7067]: Uploading segments... Aug 7 16:27:59.944925591 (6h47m59.534270568s) [upload=7067]: Got next segment. Inline: false Aug 7 16:27:59.944991657 (6h47m59.534336644s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:59.944995945 (6h47m59.534340932s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:28:00.449006469 (6h48m0.038351456s) [seg_pos={0 0}, upload=7067]: Begin upload segment... Aug 7 16:28:00.449052597 (6h48m0.038397574s) [seg_pos={0 0}, upload=7067]: Done begin upload segment. Aug 7 16:28:00.449087645 (6h48m0.038432632s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449126939 (6h48m0.038471926s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449467651 (6h48m0.038812638s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449732658 (6h48m0.039077645s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450012964 (6h48m0.039357951s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450102565 (6h48m0.039447553s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450441034 (6h48m0.039786021s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450710019 (6h48m0.040055006s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450750986 (6h48m0.040095974s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450960678 (6h48m0.040305695s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451004181 (6h48m0.040349168s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451215155 (6h48m0.040560132s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451409927 (6h48m0.040754914s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451615601 (6h48m0.040960588s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451729780 (6h48m0.041074767s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451962965 (6h48m0.041307952s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452160283 (6h48m0.04150527s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452384061 (6h48m0.041729048s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:01.571755435 (6h48m1.161100432s) [upload=7067]: Next returned nil segment Aug 7 16:28:01.571780853 (6h48m1.16112584s) [upload=7067]: Waiting for error group managing segments... Aug 7 16:28:01.882050877 (6h48m1.471395864s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.336868791 (6h48m1.926213778s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.361083941 (6h48m1.950428928s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.368873195 (6h48m1.958218182s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.370847201 (6h48m1.960192188s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.379776847 (6h48m1.969121834s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.380397114 (6h48m1.969742101s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.385457646 (6h48m1.974802633s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.412154514 (6h48m2.001499501s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.448097673 (6h48m2.03744266s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.455094621 (6h48m2.044439608s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.466113062 (6h48m2.055458049s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.467618803 (6h48m2.05696378s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505183364 (6h48m2.094528351s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505208252 (6h48m2.094553239s) [seg_pos={0 0}, upload=7067]: Segment reached optimal threshold of 14 pieces. Aug 7 16:28:02.505325958 (6h48m2.094670945s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126SqCtRGPziEeopRjA4nNkjkCZWvUwkt5XaMgcqZKJwoxuYWY7): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505385191 (6h48m2.094730178s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127dfR4NEArFbQQDa7f7C2fWeKDzeEut9nhLogdG5aZk84FxXtL): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505435848 (6h48m2.094780835s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505520660 (6h48m2.094865647s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FkuTqtaF3DmzHFvcCuJRvaubQV6HbaV1CnFtoY95QHH6NcME): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505565525 (6h48m2.094910512s) [seg_pos={0 0}, upload=7067]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:28:02.505648183 (6h48m2.094993171s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:28:02.505652633 (6h48m2.09499762s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:02.808812342 (6h48m2.398157329s) [upload=7067]: Done uploading segments... Aug 7 16:28:02.808842760 (6h48m2.398187787s) [upload=7067]: Upload finished. err: <nil> Duration: 6.137343605s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X......................................X.....] duration: 1.875713376s FAIL (2025-08-07 16:35:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.875735528s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X.......X...................................X.........] duration: 5.805455178s FAIL (2025-08-07 16:34:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3e968f3b95e0e02f307788724450fb32a5d2284f38be5ee817bb0100ee22b248 != before 4fe9b70d0b55d0afbe895ee53653b05d749598940dfe207bcb28a92d85144b3f ======LOGS====== 7 16:27:38.960521720 (6h47m38.549866707s) [upload=7062]: Done uploading segments... Aug 7 16:27:38.960539725 (6h47m38.549884712s) [upload=7062]: Upload finished. err: <nil> Aug 7 16:27:59.944544572 (6h47m59.533889549s) [upload=7067]: Starting upload Aug 7 16:27:59.944582163 (6h47m59.53392714s) [upload=7067]: Done starting upload Aug 7 16:27:59.944891205 (6h47m59.534236192s) [upload=7067]: Uploading segments... Aug 7 16:27:59.944925591 (6h47m59.534270568s) [upload=7067]: Got next segment. Inline: false Aug 7 16:27:59.944991657 (6h47m59.534336644s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:59.944995945 (6h47m59.534340932s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:28:00.449006469 (6h48m0.038351456s) [seg_pos={0 0}, upload=7067]: Begin upload segment... Aug 7 16:28:00.449052597 (6h48m0.038397574s) [seg_pos={0 0}, upload=7067]: Done begin upload segment. Aug 7 16:28:00.449087645 (6h48m0.038432632s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449126939 (6h48m0.038471926s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449467651 (6h48m0.038812638s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449732658 (6h48m0.039077645s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450012964 (6h48m0.039357951s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450102565 (6h48m0.039447553s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450441034 (6h48m0.039786021s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450710019 (6h48m0.040055006s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450750986 (6h48m0.040095974s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450960678 (6h48m0.040305695s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451004181 (6h48m0.040349168s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451215155 (6h48m0.040560132s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451409927 (6h48m0.040754914s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451615601 (6h48m0.040960588s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451729780 (6h48m0.041074767s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451962965 (6h48m0.041307952s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452160283 (6h48m0.04150527s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452384061 (6h48m0.041729048s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:01.571755435 (6h48m1.161100432s) [upload=7067]: Next returned nil segment Aug 7 16:28:01.571780853 (6h48m1.16112584s) [upload=7067]: Waiting for error group managing segments... Aug 7 16:28:01.882050877 (6h48m1.471395864s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.336868791 (6h48m1.926213778s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.361083941 (6h48m1.950428928s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.368873195 (6h48m1.958218182s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.370847201 (6h48m1.960192188s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.379776847 (6h48m1.969121834s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.380397114 (6h48m1.969742101s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.385457646 (6h48m1.974802633s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.412154514 (6h48m2.001499501s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.448097673 (6h48m2.03744266s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.455094621 (6h48m2.044439608s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.466113062 (6h48m2.055458049s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.467618803 (6h48m2.05696378s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505183364 (6h48m2.094528351s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505208252 (6h48m2.094553239s) [seg_pos={0 0}, upload=7067]: Segment reached optimal threshold of 14 pieces. Aug 7 16:28:02.505325958 (6h48m2.094670945s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126SqCtRGPziEeopRjA4nNkjkCZWvUwkt5XaMgcqZKJwoxuYWY7): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505385191 (6h48m2.094730178s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127dfR4NEArFbQQDa7f7C2fWeKDzeEut9nhLogdG5aZk84FxXtL): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505435848 (6h48m2.094780835s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505520660 (6h48m2.094865647s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FkuTqtaF3DmzHFvcCuJRvaubQV6HbaV1CnFtoY95QHH6NcME): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505565525 (6h48m2.094910512s) [seg_pos={0 0}, upload=7067]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:28:02.505648183 (6h48m2.094993171s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:28:02.505652633 (6h48m2.09499762s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:02.808812342 (6h48m2.398157329s) [upload=7067]: Done uploading segments... Aug 7 16:28:02.808842760 (6h48m2.398187787s) [upload=7067]: Upload finished. err: <nil> Duration: 5.805473173s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X.......X...................................X........] duration: 5.660296375s FAIL (2025-08-07 16:34:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3e968f3b95e0e02f307788724450fb32a5d2284f38be5ee817bb0100ee22b248 != before 4fe9b70d0b55d0afbe895ee53653b05d749598940dfe207bcb28a92d85144b3f ======LOGS====== 7 16:27:38.960521720 (6h47m38.549866707s) [upload=7062]: Done uploading segments... Aug 7 16:27:38.960539725 (6h47m38.549884712s) [upload=7062]: Upload finished. err: <nil> Aug 7 16:27:59.944544572 (6h47m59.533889549s) [upload=7067]: Starting upload Aug 7 16:27:59.944582163 (6h47m59.53392714s) [upload=7067]: Done starting upload Aug 7 16:27:59.944891205 (6h47m59.534236192s) [upload=7067]: Uploading segments... Aug 7 16:27:59.944925591 (6h47m59.534270568s) [upload=7067]: Got next segment. Inline: false Aug 7 16:27:59.944991657 (6h47m59.534336644s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:59.944995945 (6h47m59.534340932s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:28:00.449006469 (6h48m0.038351456s) [seg_pos={0 0}, upload=7067]: Begin upload segment... Aug 7 16:28:00.449052597 (6h48m0.038397574s) [seg_pos={0 0}, upload=7067]: Done begin upload segment. Aug 7 16:28:00.449087645 (6h48m0.038432632s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449126939 (6h48m0.038471926s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449467651 (6h48m0.038812638s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449732658 (6h48m0.039077645s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450012964 (6h48m0.039357951s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450102565 (6h48m0.039447553s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450441034 (6h48m0.039786021s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450710019 (6h48m0.040055006s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450750986 (6h48m0.040095974s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450960678 (6h48m0.040305695s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451004181 (6h48m0.040349168s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451215155 (6h48m0.040560132s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451409927 (6h48m0.040754914s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451615601 (6h48m0.040960588s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451729780 (6h48m0.041074767s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451962965 (6h48m0.041307952s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452160283 (6h48m0.04150527s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452384061 (6h48m0.041729048s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:01.571755435 (6h48m1.161100432s) [upload=7067]: Next returned nil segment Aug 7 16:28:01.571780853 (6h48m1.16112584s) [upload=7067]: Waiting for error group managing segments... Aug 7 16:28:01.882050877 (6h48m1.471395864s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.336868791 (6h48m1.926213778s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.361083941 (6h48m1.950428928s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.368873195 (6h48m1.958218182s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.370847201 (6h48m1.960192188s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.379776847 (6h48m1.969121834s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.380397114 (6h48m1.969742101s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.385457646 (6h48m1.974802633s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.412154514 (6h48m2.001499501s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.448097673 (6h48m2.03744266s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.455094621 (6h48m2.044439608s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.466113062 (6h48m2.055458049s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.467618803 (6h48m2.05696378s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505183364 (6h48m2.094528351s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505208252 (6h48m2.094553239s) [seg_pos={0 0}, upload=7067]: Segment reached optimal threshold of 14 pieces. Aug 7 16:28:02.505325958 (6h48m2.094670945s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126SqCtRGPziEeopRjA4nNkjkCZWvUwkt5XaMgcqZKJwoxuYWY7): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505385191 (6h48m2.094730178s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127dfR4NEArFbQQDa7f7C2fWeKDzeEut9nhLogdG5aZk84FxXtL): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505435848 (6h48m2.094780835s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505520660 (6h48m2.094865647s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FkuTqtaF3DmzHFvcCuJRvaubQV6HbaV1CnFtoY95QHH6NcME): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505565525 (6h48m2.094910512s) [seg_pos={0 0}, upload=7067]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:28:02.505648183 (6h48m2.094993171s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:28:02.505652633 (6h48m2.09499762s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:02.808812342 (6h48m2.398157329s) [upload=7067]: Done uploading segments... Aug 7 16:28:02.808842760 (6h48m2.398187787s) [upload=7067]: Upload finished. err: <nil> Duration: 5.660318438s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X......................................X....] duration: 1.826800621s FAIL (2025-08-07 16:34:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.826832742s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X......................................X...] duration: 2.052296038s FAIL (2025-08-07 16:33:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.052313432s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X.......X...................................X.......] duration: 5.854585237s FAIL (2025-08-07 16:33:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3e968f3b95e0e02f307788724450fb32a5d2284f38be5ee817bb0100ee22b248 != before 4fe9b70d0b55d0afbe895ee53653b05d749598940dfe207bcb28a92d85144b3f ======LOGS====== 7 16:27:38.960521720 (6h47m38.549866707s) [upload=7062]: Done uploading segments... Aug 7 16:27:38.960539725 (6h47m38.549884712s) [upload=7062]: Upload finished. err: <nil> Aug 7 16:27:59.944544572 (6h47m59.533889549s) [upload=7067]: Starting upload Aug 7 16:27:59.944582163 (6h47m59.53392714s) [upload=7067]: Done starting upload Aug 7 16:27:59.944891205 (6h47m59.534236192s) [upload=7067]: Uploading segments... Aug 7 16:27:59.944925591 (6h47m59.534270568s) [upload=7067]: Got next segment. Inline: false Aug 7 16:27:59.944991657 (6h47m59.534336644s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:59.944995945 (6h47m59.534340932s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:28:00.449006469 (6h48m0.038351456s) [seg_pos={0 0}, upload=7067]: Begin upload segment... Aug 7 16:28:00.449052597 (6h48m0.038397574s) [seg_pos={0 0}, upload=7067]: Done begin upload segment. Aug 7 16:28:00.449087645 (6h48m0.038432632s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449126939 (6h48m0.038471926s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449467651 (6h48m0.038812638s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449732658 (6h48m0.039077645s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450012964 (6h48m0.039357951s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450102565 (6h48m0.039447553s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450441034 (6h48m0.039786021s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450710019 (6h48m0.040055006s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450750986 (6h48m0.040095974s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450960678 (6h48m0.040305695s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451004181 (6h48m0.040349168s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451215155 (6h48m0.040560132s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451409927 (6h48m0.040754914s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451615601 (6h48m0.040960588s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451729780 (6h48m0.041074767s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451962965 (6h48m0.041307952s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452160283 (6h48m0.04150527s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452384061 (6h48m0.041729048s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:01.571755435 (6h48m1.161100432s) [upload=7067]: Next returned nil segment Aug 7 16:28:01.571780853 (6h48m1.16112584s) [upload=7067]: Waiting for error group managing segments... Aug 7 16:28:01.882050877 (6h48m1.471395864s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.336868791 (6h48m1.926213778s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.361083941 (6h48m1.950428928s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.368873195 (6h48m1.958218182s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.370847201 (6h48m1.960192188s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.379776847 (6h48m1.969121834s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.380397114 (6h48m1.969742101s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.385457646 (6h48m1.974802633s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.412154514 (6h48m2.001499501s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.448097673 (6h48m2.03744266s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.455094621 (6h48m2.044439608s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.466113062 (6h48m2.055458049s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.467618803 (6h48m2.05696378s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505183364 (6h48m2.094528351s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505208252 (6h48m2.094553239s) [seg_pos={0 0}, upload=7067]: Segment reached optimal threshold of 14 pieces. Aug 7 16:28:02.505325958 (6h48m2.094670945s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126SqCtRGPziEeopRjA4nNkjkCZWvUwkt5XaMgcqZKJwoxuYWY7): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505385191 (6h48m2.094730178s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127dfR4NEArFbQQDa7f7C2fWeKDzeEut9nhLogdG5aZk84FxXtL): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505435848 (6h48m2.094780835s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505520660 (6h48m2.094865647s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FkuTqtaF3DmzHFvcCuJRvaubQV6HbaV1CnFtoY95QHH6NcME): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505565525 (6h48m2.094910512s) [seg_pos={0 0}, upload=7067]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:28:02.505648183 (6h48m2.094993171s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:28:02.505652633 (6h48m2.09499762s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:02.808812342 (6h48m2.398157329s) [upload=7067]: Done uploading segments... Aug 7 16:28:02.808842760 (6h48m2.398187787s) [upload=7067]: Upload finished. err: <nil> Duration: 5.85460761s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X......................................X..] duration: 1.946537633s FAIL (2025-08-07 16:33:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.946564364s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X.......X...................................X......] duration: 5.852506618s FAIL (2025-08-07 16:33:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3e968f3b95e0e02f307788724450fb32a5d2284f38be5ee817bb0100ee22b248 != before 4fe9b70d0b55d0afbe895ee53653b05d749598940dfe207bcb28a92d85144b3f ======LOGS====== 7 16:27:38.960521720 (6h47m38.549866707s) [upload=7062]: Done uploading segments... Aug 7 16:27:38.960539725 (6h47m38.549884712s) [upload=7062]: Upload finished. err: <nil> Aug 7 16:27:59.944544572 (6h47m59.533889549s) [upload=7067]: Starting upload Aug 7 16:27:59.944582163 (6h47m59.53392714s) [upload=7067]: Done starting upload Aug 7 16:27:59.944891205 (6h47m59.534236192s) [upload=7067]: Uploading segments... Aug 7 16:27:59.944925591 (6h47m59.534270568s) [upload=7067]: Got next segment. Inline: false Aug 7 16:27:59.944991657 (6h47m59.534336644s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:59.944995945 (6h47m59.534340932s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:28:00.449006469 (6h48m0.038351456s) [seg_pos={0 0}, upload=7067]: Begin upload segment... Aug 7 16:28:00.449052597 (6h48m0.038397574s) [seg_pos={0 0}, upload=7067]: Done begin upload segment. Aug 7 16:28:00.449087645 (6h48m0.038432632s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449126939 (6h48m0.038471926s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449467651 (6h48m0.038812638s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449732658 (6h48m0.039077645s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450012964 (6h48m0.039357951s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450102565 (6h48m0.039447553s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450441034 (6h48m0.039786021s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450710019 (6h48m0.040055006s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450750986 (6h48m0.040095974s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450960678 (6h48m0.040305695s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451004181 (6h48m0.040349168s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451215155 (6h48m0.040560132s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451409927 (6h48m0.040754914s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451615601 (6h48m0.040960588s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451729780 (6h48m0.041074767s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451962965 (6h48m0.041307952s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452160283 (6h48m0.04150527s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452384061 (6h48m0.041729048s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:01.571755435 (6h48m1.161100432s) [upload=7067]: Next returned nil segment Aug 7 16:28:01.571780853 (6h48m1.16112584s) [upload=7067]: Waiting for error group managing segments... Aug 7 16:28:01.882050877 (6h48m1.471395864s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.336868791 (6h48m1.926213778s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.361083941 (6h48m1.950428928s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.368873195 (6h48m1.958218182s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.370847201 (6h48m1.960192188s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.379776847 (6h48m1.969121834s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.380397114 (6h48m1.969742101s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.385457646 (6h48m1.974802633s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.412154514 (6h48m2.001499501s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.448097673 (6h48m2.03744266s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.455094621 (6h48m2.044439608s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.466113062 (6h48m2.055458049s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.467618803 (6h48m2.05696378s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505183364 (6h48m2.094528351s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505208252 (6h48m2.094553239s) [seg_pos={0 0}, upload=7067]: Segment reached optimal threshold of 14 pieces. Aug 7 16:28:02.505325958 (6h48m2.094670945s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126SqCtRGPziEeopRjA4nNkjkCZWvUwkt5XaMgcqZKJwoxuYWY7): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505385191 (6h48m2.094730178s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127dfR4NEArFbQQDa7f7C2fWeKDzeEut9nhLogdG5aZk84FxXtL): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505435848 (6h48m2.094780835s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505520660 (6h48m2.094865647s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FkuTqtaF3DmzHFvcCuJRvaubQV6HbaV1CnFtoY95QHH6NcME): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505565525 (6h48m2.094910512s) [seg_pos={0 0}, upload=7067]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:28:02.505648183 (6h48m2.094993171s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:28:02.505652633 (6h48m2.09499762s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:02.808812342 (6h48m2.398157329s) [upload=7067]: Done uploading segments... Aug 7 16:28:02.808842760 (6h48m2.398187787s) [upload=7067]: Upload finished. err: <nil> Duration: 5.852532506s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X......................................X.] duration: 1.885996812s FAIL (2025-08-07 16:32:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.886020096s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X......................................X] duration: 849.888235ms FAIL (2025-08-07 16:32:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== mentMakeInline Aug 7 16:25:20.816239349 (6h45m20.405584336s) [upload=7023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:21.096970899 (6h45m20.686315876s) [upload=7023]: Done uploading segments... Aug 7 16:25:21.096990246 (6h45m20.686335233s) [upload=7023]: Upload finished. err: <nil> Aug 7 16:25:55.056721315 (6h45m54.646066302s) [upload=7035]: Starting upload Aug 7 16:25:55.056771380 (6h45m54.646116367s) [upload=7035]: Done starting upload Aug 7 16:25:55.056819052 (6h45m54.646164039s) [upload=7035]: Uploading segments... Aug 7 16:25:55.056848137 (6h45m54.646193125s) [upload=7035]: Got next segment. Inline: true Aug 7 16:25:55.056851684 (6h45m54.646196671s) [upload=7035]: Waiting for error group managing segments... Aug 7 16:25:55.056906479 (6h45m54.646251466s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:25:55.056912321 (6h45m54.646257308s) [upload=7035]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:25:55.056914725 (6h45m54.646259712s) [upload=7035]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:25:55.562799686 (6h45m55.152144673s) [upload=7035]: Done uploading segments... Aug 7 16:25:55.562826908 (6h45m55.152171895s) [upload=7035]: Upload finished. err: <nil> Aug 7 16:26:21.858468314 (6h46m21.447813291s) [upload=7041]: Starting upload Aug 7 16:26:21.858514102 (6h46m21.447859079s) [upload=7041]: Done starting upload Aug 7 16:26:21.858592271 (6h46m21.447937258s) [upload=7041]: Uploading segments... Aug 7 16:26:21.858687593 (6h46m21.44803258s) [upload=7041]: Got next segment. Inline: true Aug 7 16:26:21.858692242 (6h46m21.448037219s) [upload=7041]: Waiting for error group managing segments... Aug 7 16:26:21.858745534 (6h46m21.448090521s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:21.858750323 (6h46m21.44809531s) [upload=7041]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:21.858752848 (6h46m21.448097835s) [upload=7041]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:22.139056659 (6h46m21.728401646s) [upload=7041]: Done uploading segments... Aug 7 16:26:22.139076296 (6h46m21.728421283s) [upload=7041]: Upload finished. err: <nil> Aug 7 16:26:57.477353003 (6h46m57.06669798s) [upload=7049]: Starting upload Aug 7 16:26:57.477397177 (6h46m57.066742154s) [upload=7049]: Done starting upload Aug 7 16:26:57.477445169 (6h46m57.066790156s) [upload=7049]: Uploading segments... Aug 7 16:26:57.477479485 (6h46m57.066824482s) [upload=7049]: Got next segment. Inline: true Aug 7 16:26:57.477483312 (6h46m57.066828309s) [upload=7049]: Waiting for error group managing segments... Aug 7 16:26:57.477522147 (6h46m57.066867134s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:26:57.477526174 (6h46m57.066871161s) [upload=7049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:26:57.477528388 (6h46m57.066873375s) [upload=7049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:26:57.754079640 (6h46m57.343424687s) [upload=7049]: Done uploading segments... Aug 7 16:26:57.754101803 (6h46m57.34344678s) [upload=7049]: Upload finished. err: <nil> Aug 7 16:27:12.733007348 (6h47m12.322352335s) [upload=7056]: Starting upload Aug 7 16:27:12.733051042 (6h47m12.322396029s) [upload=7056]: Done starting upload Aug 7 16:27:12.733104294 (6h47m12.322449281s) [upload=7056]: Uploading segments... Aug 7 16:27:12.733134382 (6h47m12.322479359s) [upload=7056]: Got next segment. Inline: true Aug 7 16:27:12.733138409 (6h47m12.322483396s) [upload=7056]: Waiting for error group managing segments... Aug 7 16:27:12.733172264 (6h47m12.322517251s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:12.733175871 (6h47m12.322520858s) [upload=7056]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:12.733178205 (6h47m12.322523192s) [upload=7056]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:13.002665771 (6h47m12.592010778s) [upload=7056]: Done uploading segments... Aug 7 16:27:13.002682172 (6h47m12.592027159s) [upload=7056]: Upload finished. err: <nil> Aug 7 16:27:40.565209038 (6h47m40.154554025s) [upload=7063]: Starting upload Aug 7 16:27:40.565259935 (6h47m40.154604922s) [upload=7063]: Done starting upload Aug 7 16:27:40.565315571 (6h47m40.154660558s) [upload=7063]: Uploading segments... Aug 7 16:27:40.565348976 (6h47m40.154693963s) [upload=7063]: Got next segment. Inline: true Aug 7 16:27:40.565353194 (6h47m40.154698181s) [upload=7063]: Waiting for error group managing segments... Aug 7 16:27:40.565385836 (6h47m40.154730823s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:40.565389623 (6h47m40.15473461s) [upload=7063]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:27:40.565391948 (6h47m40.154736925s) [upload=7063]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:27:40.849961440 (6h47m40.439306427s) [upload=7063]: Done uploading segments... Aug 7 16:27:40.849987169 (6h47m40.439332156s) [upload=7063]: Upload finished. err: <nil> Aug 7 16:28:24.356014617 (6h48m23.945359634s) [upload=7076]: Starting upload Aug 7 16:28:24.356109709 (6h48m23.945454736s) [upload=7076]: Done starting upload Aug 7 16:28:24.356203459 (6h48m23.945548476s) [upload=7076]: Uploading segments... Aug 7 16:28:24.356257973 (6h48m23.94560299s) [upload=7076]: Got next segment. Inline: true Aug 7 16:28:24.356264756 (6h48m23.945609763s) [upload=7076]: Waiting for error group managing segments... Aug 7 16:28:24.356327566 (6h48m23.945672563s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:24.356334379 (6h48m23.945679366s) [upload=7076]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:24.356339199 (6h48m23.945684196s) [upload=7076]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:24.867039141 (6h48m24.456384138s) [upload=7076]: Done uploading segments... Aug 7 16:28:24.867057687 (6h48m24.456402674s) [upload=7076]: Upload finished. err: <nil> Aug 7 16:28:50.953533517 (6h48m50.542878504s) [upload=7084]: Starting upload Aug 7 16:28:50.953581949 (6h48m50.542926926s) [upload=7084]: Done starting upload Aug 7 16:28:50.953629871 (6h48m50.542974848s) [upload=7084]: Uploading segments... Aug 7 16:28:50.953662293 (6h48m50.54300728s) [upload=7084]: Got next segment. Inline: true Aug 7 16:28:50.953666100 (6h48m50.543011087s) [upload=7084]: Waiting for error group managing segments... Aug 7 16:28:50.953702410 (6h48m50.543047397s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:28:50.953706659 (6h48m50.543051646s) [upload=7084]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:28:50.953709093 (6h48m50.54305408s) [upload=7084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:51.240830436 (6h48m50.830175423s) [upload=7084]: Done uploading segments... Aug 7 16:28:51.240848812 (6h48m50.830193799s) [upload=7084]: Upload finished. err: <nil> Aug 7 16:30:04.163544016 (6h50m3.752889013s) [upload=7106]: Starting upload Aug 7 16:30:04.163610033 (6h50m3.75295505s) [upload=7106]: Done starting upload Aug 7 16:30:04.163678623 (6h50m3.753023621s) [upload=7106]: Uploading segments... Aug 7 16:30:04.163725533 (6h50m3.753070531s) [upload=7106]: Got next segment. Inline: true Aug 7 16:30:04.163734059 (6h50m3.753079047s) [upload=7106]: Waiting for error group managing segments... Aug 7 16:30:04.163785157 (6h50m3.753130144s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:30:04.163791139 (6h50m3.753136126s) [upload=7106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:30:04.163794585 (6h50m3.753139582s) [upload=7106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:30:04.632318313 (6h50m4.2216633s) [upload=7106]: Done uploading segments... Aug 7 16:30:04.632341728 (6h50m4.221686715s) [upload=7106]: Upload finished. err: <nil> Aug 7 16:31:13.056335618 (6h51m12.645680605s) [upload=7130]: Starting upload Aug 7 16:31:13.056393518 (6h51m12.645738505s) [upload=7130]: Done starting upload Aug 7 16:31:13.056498259 (6h51m12.645843296s) [upload=7130]: Uploading segments... Aug 7 16:31:13.056773485 (6h51m12.646118472s) [upload=7130]: Got next segment. Inline: true Aug 7 16:31:13.056783023 (6h51m12.64612801s) [upload=7130]: Waiting for error group managing segments... Aug 7 16:31:13.056844891 (6h51m12.646189878s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:31:13.056849140 (6h51m12.646194127s) [upload=7130]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:31:13.056851835 (6h51m12.646196822s) [upload=7130]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:31:13.371373984 (6h51m12.960718971s) [upload=7130]: Done uploading segments... Aug 7 16:31:13.371389734 (6h51m12.960734722s) [upload=7130]: Upload finished. err: <nil> Aug 7 16:32:04.837203281 (6h52m4.426548288s) [upload=7147]: Starting upload Aug 7 16:32:04.837279786 (6h52m4.426624793s) [upload=7147]: Done starting upload Aug 7 16:32:04.837352586 (6h52m4.426697593s) [upload=7147]: Uploading segments... Aug 7 16:32:04.837394887 (6h52m4.426739904s) [upload=7147]: Got next segment. Inline: true Aug 7 16:32:04.837400808 (6h52m4.426745815s) [upload=7147]: Waiting for error group managing segments... Aug 7 16:32:04.837452868 (6h52m4.426797885s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:32:04.837458749 (6h52m4.426803736s) [upload=7147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:32:04.837462757 (6h52m4.426807754s) [upload=7147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:32:05.048006856 (6h52m4.637351834s) [upload=7147]: Done uploading segments... Aug 7 16:32:05.048026574 (6h52m4.637371562s) [upload=7147]: Upload finished. err: metaclient: Too Many Requests Duration:* 849.909997ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X.......X...................................X.....] duration: 5.999122217s FAIL (2025-08-07 16:31:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3e968f3b95e0e02f307788724450fb32a5d2284f38be5ee817bb0100ee22b248 != before 4fe9b70d0b55d0afbe895ee53653b05d749598940dfe207bcb28a92d85144b3f ======LOGS====== 7 16:27:38.960521720 (6h47m38.549866707s) [upload=7062]: Done uploading segments... Aug 7 16:27:38.960539725 (6h47m38.549884712s) [upload=7062]: Upload finished. err: <nil> Aug 7 16:27:59.944544572 (6h47m59.533889549s) [upload=7067]: Starting upload Aug 7 16:27:59.944582163 (6h47m59.53392714s) [upload=7067]: Done starting upload Aug 7 16:27:59.944891205 (6h47m59.534236192s) [upload=7067]: Uploading segments... Aug 7 16:27:59.944925591 (6h47m59.534270568s) [upload=7067]: Got next segment. Inline: false Aug 7 16:27:59.944991657 (6h47m59.534336644s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:59.944995945 (6h47m59.534340932s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:28:00.449006469 (6h48m0.038351456s) [seg_pos={0 0}, upload=7067]: Begin upload segment... Aug 7 16:28:00.449052597 (6h48m0.038397574s) [seg_pos={0 0}, upload=7067]: Done begin upload segment. Aug 7 16:28:00.449087645 (6h48m0.038432632s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449126939 (6h48m0.038471926s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449467651 (6h48m0.038812638s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449732658 (6h48m0.039077645s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450012964 (6h48m0.039357951s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450102565 (6h48m0.039447553s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450441034 (6h48m0.039786021s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450710019 (6h48m0.040055006s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450750986 (6h48m0.040095974s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450960678 (6h48m0.040305695s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451004181 (6h48m0.040349168s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451215155 (6h48m0.040560132s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451409927 (6h48m0.040754914s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451615601 (6h48m0.040960588s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451729780 (6h48m0.041074767s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451962965 (6h48m0.041307952s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452160283 (6h48m0.04150527s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452384061 (6h48m0.041729048s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:01.571755435 (6h48m1.161100432s) [upload=7067]: Next returned nil segment Aug 7 16:28:01.571780853 (6h48m1.16112584s) [upload=7067]: Waiting for error group managing segments... Aug 7 16:28:01.882050877 (6h48m1.471395864s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.336868791 (6h48m1.926213778s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.361083941 (6h48m1.950428928s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.368873195 (6h48m1.958218182s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.370847201 (6h48m1.960192188s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.379776847 (6h48m1.969121834s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.380397114 (6h48m1.969742101s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.385457646 (6h48m1.974802633s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.412154514 (6h48m2.001499501s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.448097673 (6h48m2.03744266s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.455094621 (6h48m2.044439608s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.466113062 (6h48m2.055458049s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.467618803 (6h48m2.05696378s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505183364 (6h48m2.094528351s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505208252 (6h48m2.094553239s) [seg_pos={0 0}, upload=7067]: Segment reached optimal threshold of 14 pieces. Aug 7 16:28:02.505325958 (6h48m2.094670945s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126SqCtRGPziEeopRjA4nNkjkCZWvUwkt5XaMgcqZKJwoxuYWY7): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505385191 (6h48m2.094730178s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127dfR4NEArFbQQDa7f7C2fWeKDzeEut9nhLogdG5aZk84FxXtL): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505435848 (6h48m2.094780835s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505520660 (6h48m2.094865647s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FkuTqtaF3DmzHFvcCuJRvaubQV6HbaV1CnFtoY95QHH6NcME): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505565525 (6h48m2.094910512s) [seg_pos={0 0}, upload=7067]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:28:02.505648183 (6h48m2.094993171s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:28:02.505652633 (6h48m2.09499762s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:02.808812342 (6h48m2.398157329s) [upload=7067]: Done uploading segments... Aug 7 16:28:02.808842760 (6h48m2.398187787s) [upload=7067]: Upload finished. err: <nil> Duration: 5.999151504s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X.......X...................................X....] duration: 5.517346764s FAIL (2025-08-07 16:31:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3e968f3b95e0e02f307788724450fb32a5d2284f38be5ee817bb0100ee22b248 != before 4fe9b70d0b55d0afbe895ee53653b05d749598940dfe207bcb28a92d85144b3f ======LOGS====== 7 16:27:38.960521720 (6h47m38.549866707s) [upload=7062]: Done uploading segments... Aug 7 16:27:38.960539725 (6h47m38.549884712s) [upload=7062]: Upload finished. err: <nil> Aug 7 16:27:59.944544572 (6h47m59.533889549s) [upload=7067]: Starting upload Aug 7 16:27:59.944582163 (6h47m59.53392714s) [upload=7067]: Done starting upload Aug 7 16:27:59.944891205 (6h47m59.534236192s) [upload=7067]: Uploading segments... Aug 7 16:27:59.944925591 (6h47m59.534270568s) [upload=7067]: Got next segment. Inline: false Aug 7 16:27:59.944991657 (6h47m59.534336644s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:59.944995945 (6h47m59.534340932s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:28:00.449006469 (6h48m0.038351456s) [seg_pos={0 0}, upload=7067]: Begin upload segment... Aug 7 16:28:00.449052597 (6h48m0.038397574s) [seg_pos={0 0}, upload=7067]: Done begin upload segment. Aug 7 16:28:00.449087645 (6h48m0.038432632s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449126939 (6h48m0.038471926s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449467651 (6h48m0.038812638s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449732658 (6h48m0.039077645s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450012964 (6h48m0.039357951s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450102565 (6h48m0.039447553s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450441034 (6h48m0.039786021s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450710019 (6h48m0.040055006s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450750986 (6h48m0.040095974s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450960678 (6h48m0.040305695s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451004181 (6h48m0.040349168s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451215155 (6h48m0.040560132s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451409927 (6h48m0.040754914s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451615601 (6h48m0.040960588s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451729780 (6h48m0.041074767s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451962965 (6h48m0.041307952s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452160283 (6h48m0.04150527s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452384061 (6h48m0.041729048s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:01.571755435 (6h48m1.161100432s) [upload=7067]: Next returned nil segment Aug 7 16:28:01.571780853 (6h48m1.16112584s) [upload=7067]: Waiting for error group managing segments... Aug 7 16:28:01.882050877 (6h48m1.471395864s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.336868791 (6h48m1.926213778s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.361083941 (6h48m1.950428928s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.368873195 (6h48m1.958218182s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.370847201 (6h48m1.960192188s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.379776847 (6h48m1.969121834s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.380397114 (6h48m1.969742101s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.385457646 (6h48m1.974802633s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.412154514 (6h48m2.001499501s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.448097673 (6h48m2.03744266s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.455094621 (6h48m2.044439608s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.466113062 (6h48m2.055458049s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.467618803 (6h48m2.05696378s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505183364 (6h48m2.094528351s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505208252 (6h48m2.094553239s) [seg_pos={0 0}, upload=7067]: Segment reached optimal threshold of 14 pieces. Aug 7 16:28:02.505325958 (6h48m2.094670945s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126SqCtRGPziEeopRjA4nNkjkCZWvUwkt5XaMgcqZKJwoxuYWY7): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505385191 (6h48m2.094730178s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127dfR4NEArFbQQDa7f7C2fWeKDzeEut9nhLogdG5aZk84FxXtL): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505435848 (6h48m2.094780835s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505520660 (6h48m2.094865647s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FkuTqtaF3DmzHFvcCuJRvaubQV6HbaV1CnFtoY95QHH6NcME): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505565525 (6h48m2.094910512s) [seg_pos={0 0}, upload=7067]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:28:02.505648183 (6h48m2.094993171s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:28:02.505652633 (6h48m2.09499762s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:02.808812342 (6h48m2.398157329s) [upload=7067]: Done uploading segments... Aug 7 16:28:02.808842760 (6h48m2.398187787s) [upload=7067]: Upload finished. err: <nil> Duration: 5.517375699s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 1.886192537s FAIL (2025-08-07 16:31:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== entMakeInline Aug 7 15:57:10.271829415 (6h17m9.861174403s) [upload=6533]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 15:57:10.587098885 (6h17m10.176443872s) [upload=6533]: Done uploading segments... Aug 7 15:57:10.587115857 (6h17m10.176460835s) [upload=6533]: Upload finished. err: <nil> Aug 7 15:57:48.918901442 (6h17m48.508246429s) [upload=6545]: Starting upload Aug 7 15:57:48.918948701 (6h17m48.508293688s) [upload=6545]: Done starting upload Aug 7 15:57:48.919013486 (6h17m48.508358473s) [upload=6545]: Uploading segments... Aug 7 15:57:48.919055005 (6h17m48.508399982s) [upload=6545]: Got next segment. Inline: true Aug 7 15:57:48.919059032 (6h17m48.508404009s) [upload=6545]: Waiting for error group managing segments... Aug 7 15:57:48.919091585 (6h17m48.508436572s) [upload=6545]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 15:57:48.919095493 (6h17m48.50844048s) [upload=6545]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 15:57:48.919097998 (6h17m48.508442975s) [upload=6545]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 15:57:49.200378977 (6h17m48.789723964s) [upload=6545]: Done uploading segments... Aug 7 15:57:49.200397332 (6h17m48.789742319s) [upload=6545]: Upload finished. err: <nil> Aug 7 15:58:50.898935036 (6h18m50.488280023s) [upload=6562]: Starting upload Aug 7 15:58:50.898979992 (6h18m50.488324979s) [upload=6562]: Done starting upload Aug 7 15:58:50.899026682 (6h18m50.488371669s) [upload=6562]: Uploading segments... Aug 7 15:58:50.899065355 (6h18m50.488410343s) [upload=6562]: Got next segment. Inline: true Aug 7 15:58:50.899070335 (6h18m50.488415322s) [upload=6562]: Waiting for error group managing segments... Aug 7 15:58:50.899108268 (6h18m50.488453255s) [upload=6562]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 15:58:50.899112326 (6h18m50.488457313s) [upload=6562]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 15:58:50.899114820 (6h18m50.488459807s) [upload=6562]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 15:58:51.203289783 (6h18m50.79263478s) [upload=6562]: Done uploading segments... Aug 7 15:58:51.203312587 (6h18m50.792657624s) [upload=6562]: Upload finished. err: <nil> Aug 7 16:00:00.470970125 (6h20m0.060315112s) [upload=6580]: Starting upload Aug 7 16:00:00.471017334 (6h20m0.060362321s) [upload=6580]: Done starting upload Aug 7 16:00:00.471072199 (6h20m0.060417186s) [upload=6580]: Uploading segments... Aug 7 16:00:00.471112327 (6h20m0.060457314s) [upload=6580]: Got next segment. Inline: true Aug 7 16:00:00.471116364 (6h20m0.060461351s) [upload=6580]: Waiting for error group managing segments... Aug 7 16:00:00.471149427 (6h20m0.060494414s) [upload=6580]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:00:00.471153305 (6h20m0.060498292s) [upload=6580]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:00:00.471155819 (6h20m0.060500806s) [upload=6580]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:00:00.739624026 (6h20m0.328969023s) [upload=6580]: Done uploading segments... Aug 7 16:00:00.739645636 (6h20m0.328990623s) [upload=6580]: Upload finished. err: <nil> Aug 7 16:00:49.882359165 (6h20m49.471704152s) [upload=6598]: Starting upload Aug 7 16:00:49.882404682 (6h20m49.471749659s) [upload=6598]: Done starting upload Aug 7 16:00:49.882456812 (6h20m49.471801799s) [upload=6598]: Uploading segments... Aug 7 16:00:49.882489865 (6h20m49.471834852s) [upload=6598]: Got next segment. Inline: true Aug 7 16:00:49.882493702 (6h20m49.47183869s) [upload=6598]: Waiting for error group managing segments... Aug 7 16:00:49.882525894 (6h20m49.471870881s) [upload=6598]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:00:49.882529422 (6h20m49.471874399s) [upload=6598]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:00:49.882531676 (6h20m49.471876663s) [upload=6598]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:00:50.213720013 (6h20m49.803065s) [upload=6598]: Done uploading segments... Aug 7 16:00:50.213739550 (6h20m49.803084537s) [upload=6598]: Upload finished. err: <nil> Aug 7 16:01:51.762778733 (6h21m51.35212372s) [upload=6617]: Starting upload Aug 7 16:01:51.762856161 (6h21m51.352201148s) [upload=6617]: Done starting upload Aug 7 16:01:51.762914883 (6h21m51.35225987s) [upload=6617]: Uploading segments... Aug 7 16:01:51.762952445 (6h21m51.352297432s) [upload=6617]: Got next segment. Inline: true Aug 7 16:01:51.762957344 (6h21m51.352302331s) [upload=6617]: Waiting for error group managing segments... Aug 7 16:01:51.762994485 (6h21m51.352339473s) [upload=6617]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:01:51.762998313 (6h21m51.3523433s) [upload=6617]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:01:51.763001278 (6h21m51.352346265s) [upload=6617]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:01:52.034377407 (6h21m51.623722394s) [upload=6617]: Done uploading segments... Aug 7 16:01:52.034395451 (6h21m51.623740439s) [upload=6617]: Upload finished. err: <nil> Aug 7 16:02:11.154406473 (6h22m10.74375146s) [upload=6618]: Starting upload Aug 7 16:02:11.154456328 (6h22m10.743801315s) [upload=6618]: Done starting upload Aug 7 16:02:11.154503859 (6h22m10.743848846s) [upload=6618]: Uploading segments... Aug 7 16:02:11.154545308 (6h22m10.743890295s) [upload=6618]: Got next segment. Inline: true Aug 7 16:02:11.154548574 (6h22m10.743893561s) [upload=6618]: Waiting for error group managing segments... Aug 7 16:02:11.154580566 (6h22m10.743925553s) [upload=6618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:02:11.154584283 (6h22m10.74392927s) [upload=6618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:02:11.154586828 (6h22m10.743931815s) [upload=6618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:02:11.475329609 (6h22m11.064674596s) [upload=6618]: Done uploading segments... Aug 7 16:02:11.475484125 (6h22m11.064829112s) [upload=6618]: Upload finished. err: <nil> Aug 7 16:02:42.941029250 (6h22m42.530374238s) [upload=6628]: Starting upload Aug 7 16:02:42.941096740 (6h22m42.530441727s) [upload=6628]: Done starting upload Aug 7 16:02:42.941158728 (6h22m42.530503716s) [upload=6628]: Uploading segments... Aug 7 16:02:42.941210478 (6h22m42.530555465s) [upload=6628]: Got next segment. Inline: true Aug 7 16:02:42.941216419 (6h22m42.530561416s) [upload=6628]: Waiting for error group managing segments... Aug 7 16:02:42.941281664 (6h22m42.530626651s) [upload=6628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:02:42.941286824 (6h22m42.530631811s) [upload=6628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:02:42.941289880 (6h22m42.530634867s) [upload=6628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:02:43.233814342 (6h22m42.823159339s) [upload=6628]: Done uploading segments... Aug 7 16:02:43.233838148 (6h22m42.823183145s) [upload=6628]: Upload finished. err: <nil> Aug 7 16:03:45.201690833 (6h23m44.79103582s) [upload=6651]: Starting upload Aug 7 16:03:45.201738173 (6h23m44.79108316s) [upload=6651]: Done starting upload Aug 7 16:03:45.201785534 (6h23m44.791130511s) [upload=6651]: Uploading segments... Aug 7 16:03:45.201855618 (6h23m44.791200605s) [upload=6651]: Got next segment. Inline: true Aug 7 16:03:45.201859616 (6h23m44.791204603s) [upload=6651]: Waiting for error group managing segments... Aug 7 16:03:45.201894122 (6h23m44.791239109s) [upload=6651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:03:45.201897799 (6h23m44.791242786s) [upload=6651]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:03:45.201900023 (6h23m44.79124501s) [upload=6651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:03:45.644503676 (6h23m45.233848664s) [upload=6651]: Done uploading segments... Aug 7 16:03:45.644521010 (6h23m45.233865987s) [upload=6651]: Upload finished. err: <nil> Aug 7 16:04:31.274936212 (6h24m30.864281199s) [upload=6663]: Starting upload Aug 7 16:04:31.274977170 (6h24m30.864322157s) [upload=6663]: Done starting upload Aug 7 16:04:31.275026655 (6h24m30.864371642s) [upload=6663]: Uploading segments... Aug 7 16:04:31.275054187 (6h24m30.864399174s) [upload=6663]: Got next segment. Inline: true Aug 7 16:04:31.275057754 (6h24m30.864402731s) [upload=6663]: Waiting for error group managing segments... Aug 7 16:04:31.275091278 (6h24m30.864436265s) [upload=6663]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:04:31.275095255 (6h24m30.864440242s) [upload=6663]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:04:31.275097651 (6h24m30.864442638s) [upload=6663]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:04:31.554258512 (6h24m31.143603499s) [upload=6663]: Done uploading segments... Aug 7 16:04:31.554277108 (6h24m31.143622095s) [upload=6663]: Upload finished. err: <nil> Aug 7 16:05:14.730035713 (6h25m14.3193807s) [upload=6674]: Starting upload Aug 7 16:05:14.730082813 (6h25m14.3194278s) [upload=6674]: Done starting upload Aug 7 16:05:14.730159079 (6h25m14.319504056s) [upload=6674]: Uploading segments... Aug 7 16:05:14.730249532 (6h25m14.319594519s) [upload=6674]: Got next segment. Inline: true Aug 7 16:05:14.730254050 (6h25m14.319599037s) [upload=6674]: Waiting for error group managing segments... Aug 7 16:05:14.730294949 (6h25m14.319639936s) [upload=6674]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:05:14.730299728 (6h25m14.319644715s) [upload=6674]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:05:14.730302243 (6h25m14.31964723s) [upload=6674]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:05:14.942773689 (6h25m14.532118666s) [upload=6674]: Done uploading segments... Aug 7 16:05:14.942790141 (6h25m14.532135118s) [upload=6674]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.886227032s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X.......X...................................X...] duration: 6.004764448s FAIL (2025-08-07 16:31:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3e968f3b95e0e02f307788724450fb32a5d2284f38be5ee817bb0100ee22b248 != before 4fe9b70d0b55d0afbe895ee53653b05d749598940dfe207bcb28a92d85144b3f ======LOGS====== 7 16:27:38.960521720 (6h47m38.549866707s) [upload=7062]: Done uploading segments... Aug 7 16:27:38.960539725 (6h47m38.549884712s) [upload=7062]: Upload finished. err: <nil> Aug 7 16:27:59.944544572 (6h47m59.533889549s) [upload=7067]: Starting upload Aug 7 16:27:59.944582163 (6h47m59.53392714s) [upload=7067]: Done starting upload Aug 7 16:27:59.944891205 (6h47m59.534236192s) [upload=7067]: Uploading segments... Aug 7 16:27:59.944925591 (6h47m59.534270568s) [upload=7067]: Got next segment. Inline: false Aug 7 16:27:59.944991657 (6h47m59.534336644s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:27:59.944995945 (6h47m59.534340932s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:28:00.449006469 (6h48m0.038351456s) [seg_pos={0 0}, upload=7067]: Begin upload segment... Aug 7 16:28:00.449052597 (6h48m0.038397574s) [seg_pos={0 0}, upload=7067]: Done begin upload segment. Aug 7 16:28:00.449087645 (6h48m0.038432632s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449126939 (6h48m0.038471926s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449467651 (6h48m0.038812638s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.449732658 (6h48m0.039077645s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450012964 (6h48m0.039357951s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450102565 (6h48m0.039447553s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450441034 (6h48m0.039786021s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450710019 (6h48m0.040055006s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450750986 (6h48m0.040095974s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.450960678 (6h48m0.040305695s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451004181 (6h48m0.040349168s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451215155 (6h48m0.040560132s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451409927 (6h48m0.040754914s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451615601 (6h48m0.040960588s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451729780 (6h48m0.041074767s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.451962965 (6h48m0.041307952s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452160283 (6h48m0.04150527s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:00.452384061 (6h48m0.041729048s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Uploading piece... Aug 7 16:28:01.571755435 (6h48m1.161100432s) [upload=7067]: Next returned nil segment Aug 7 16:28:01.571780853 (6h48m1.16112584s) [upload=7067]: Waiting for error group managing segments... Aug 7 16:28:01.882050877 (6h48m1.471395864s) [noise=true , address=64.49.13.138:4487 , piece_id=UZ7YVPDLF4ABTMVUDPDRDN2IPFOIFF37CWAJTIJVUPYBEZM6CW6Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.336868791 (6h48m1.926213778s) [noise=true , address=45.91.116.8:4058 , piece_id=W5P7HVDQIJAIWLA3ISOKKGRULRI5XEXHWRFKIOJRCN7OAPEFZQGQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.361083941 (6h48m1.950428928s) [noise=true , address=104.36.82.39:4739 , piece_id=3SDQNWAATOJR5UYCRBTNLKWOCZC5NOHL2CFIRQPL6Q5NRAFSV4IQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.368873195 (6h48m1.958218182s) [noise=true , address=77.90.31.19:4860 , piece_id=YJNA67POUELT37EOTTE7J65WDWBNY5OTD7SGLQKTLK2FO3W6FX2Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.370847201 (6h48m1.960192188s) [noise=true , address=156.146.43.225:4466 , piece_id=5AKB4R74UMAMR52IZX5FLRGKCLET225UH47VA3NO4KFK5QE5VGNA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.379776847 (6h48m1.969121834s) [noise=true , address=104.36.82.18:4399 , piece_id=X544FOYSGHRWTSUHTJ4K6WSX4KEGWRO2QUL7CJTG6CFCC7PSPNQA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.380397114 (6h48m1.969742101s) [noise=true , address=79.127.201.215:4359 , piece_id=IVO7RBVQMB5LR4PM4VIXIBVRPAX66DJBUZMTEQWBAX7WRYV3RM3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.385457646 (6h48m1.974802633s) [noise=true , address=104.36.82.16:4300 , piece_id=4GTFQ5LLIPRC3LSRQMO4PQX35MNRW3SFXIATE3BNTTPBX6GUR2DQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.412154514 (6h48m2.001499501s) [noise=true , address=45.91.116.6:4984 , piece_id=LZGOKJWPPLN5JS6XVVP5RLG4U73QVPZMNL3QRYKPQ635SVYMDD4Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.448097673 (6h48m2.03744266s) [noise=true , address=104.36.82.55:4214 , piece_id=2IC2BQQNZY37ZDDHWPY6ONLXEDME4TLJ6ZMRKRBCFRF7ESCUL6HA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.455094621 (6h48m2.044439608s) [noise=true , address=104.36.82.37:4653 , piece_id=X7IKERZ7CNA5PN6Y7TBPAGDYLL2SHHI5HRIATV6ZHDNIIUI745SA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.466113062 (6h48m2.055458049s) [noise=true , address=104.36.82.45:4935 , piece_id=EXPJJRKWF5MKTGIIUXW5E3IR6BW3D4Q3LNRLURS3YGMKDFEETD3Q, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.467618803 (6h48m2.05696378s) [noise=true , address=104.36.82.52:4114 , piece_id=UJY4ESEQB2WFYZMHZRYEVXE2ODVPXT33SOGOOPCXSFV7WAVQ5B2A, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505183364 (6h48m2.094528351s) [noise=true , address=45.91.116.13:4186 , piece_id=MIDL3DMLAOLYJBHED2ZWSL2QK2V5MDC4LD2ILHD2ZHVIH4BXAMCQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: <nil> Aug 7 16:28:02.505208252 (6h48m2.094553239s) [seg_pos={0 0}, upload=7067]: Segment reached optimal threshold of 14 pieces. Aug 7 16:28:02.505325958 (6h48m2.094670945s) [noise=true , address=104.36.82.43:4859 , piece_id=LTFPBVXEHV3KPYOTOTONPS67M6KUC4BHSWOOKKI5S4SRHCCF3GOA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126SqCtRGPziEeopRjA4nNkjkCZWvUwkt5XaMgcqZKJwoxuYWY7): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505385191 (6h48m2.094730178s) [noise=true , address=104.36.82.62:4417 , piece_id=DI7VPLCM67N5NB6PPKQ6Q737NUIDZKO2IHBLYQ7IE22TZGB5IHRA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127dfR4NEArFbQQDa7f7C2fWeKDzeEut9nhLogdG5aZk84FxXtL): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505435848 (6h48m2.094780835s) [noise=true , address=104.36.82.23:4449 , piece_id=ZFCBNDWYURE5II6W76VJNQPVNR7F67SBTWMD77TWA2DORHAJKAMA, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f14pHDEEamEnHmeZCe38rjaE6EYWYkGMPrZMsbSDmApN5rckq): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505520660 (6h48m2.094865647s) [noise=true , address=104.36.82.44:4888 , piece_id=C3VTAG6HEMY2VIX35BGCJWG6P7VEFGGTEZ2WMTNHUHJOPYXLYTWQ, seg_pos={0 0}, upload=7067]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FkuTqtaF3DmzHFvcCuJRvaubQV6HbaV1CnFtoY95QHH6NcME): protocol: expected piece hash; context canceled; EOF Aug 7 16:28:02.505565525 (6h48m2.094910512s) [seg_pos={0 0}, upload=7067]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:28:02.505648183 (6h48m2.094993171s) [upload=7067]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:28:02.505652633 (6h48m2.09499762s) [upload=7067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:28:02.808812342 (6h48m2.398157329s) [upload=7067]: Done uploading segments... Aug 7 16:28:02.808842760 (6h48m2.398187787s) [upload=7067]: Upload finished. err: <nil> Duration: 6.004796381s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)