Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.....X..X........................X......X...X.........X.....] duration: 1.816250057s FAIL (2025-08-08 09:30:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== ) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Aug 8 09:19:50.816124617 (23h39m50.405469634s) [upload=24509]: Starting upload Aug 8 09:19:50.816190393 (23h39m50.4055354s) [upload=24509]: Done starting upload Aug 8 09:19:50.816260407 (23h39m50.405605414s) [upload=24509]: Uploading segments... Aug 8 09:19:50.816304711 (23h39m50.405649718s) [upload=24509]: Got next segment. Inline: true Aug 8 09:19:50.816310652 (23h39m50.40565566s) [upload=24509]: Waiting for error group managing segments... Aug 8 09:19:50.816354387 (23h39m50.405699374s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:19:50.816358344 (23h39m50.405703331s) [upload=24509]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:19:50.816360648 (23h39m50.405705625s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:19:51.094341032 (23h39m50.683686009s) [upload=24509]: Done uploading segments... Aug 8 09:19:51.094358025 (23h39m50.683703002s) [upload=24509]: Upload finished. err: <nil> Aug 8 09:20:47.238623223 (23h40m46.82796821s) [upload=24525]: Starting upload Aug 8 09:20:47.238678168 (23h40m46.828023145s) [upload=24525]: Done starting upload Aug 8 09:20:47.238798478 (23h40m46.828143466s) [upload=24525]: Uploading segments... Aug 8 09:20:47.238875896 (23h40m46.828220873s) [upload=24525]: Got next segment. Inline: true Aug 8 09:20:47.238880826 (23h40m46.828225813s) [upload=24525]: Waiting for error group managing segments... Aug 8 09:20:47.238922375 (23h40m46.828267352s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:20:47.238927194 (23h40m46.828272171s) [upload=24525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:20:47.238929619 (23h40m46.828274596s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:20:47.505079067 (23h40m47.094424054s) [upload=24525]: Done uploading segments... Aug 8 09:20:47.505096551 (23h40m47.094441538s) [upload=24525]: Upload finished. err: <nil> Aug 8 09:21:17.068435608 (23h41m16.657780595s) [upload=24534]: Starting upload Aug 8 09:21:17.068474893 (23h41m16.65781988s) [upload=24534]: Done starting upload Aug 8 09:21:17.068516683 (23h41m16.65786167s) [upload=24534]: Uploading segments... Aug 8 09:21:17.068545869 (23h41m16.657890846s) [upload=24534]: Got next segment. Inline: true Aug 8 09:21:17.068549796 (23h41m16.657894783s) [upload=24534]: Waiting for error group managing segments... Aug 8 09:21:17.068578140 (23h41m16.657923127s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:17.068581847 (23h41m16.657926834s) [upload=24534]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:17.068584202 (23h41m16.657929189s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:17.343299629 (23h41m16.932644616s) [upload=24534]: Done uploading segments... Aug 8 09:21:17.343319026 (23h41m16.932664013s) [upload=24534]: Upload finished. err: <nil> Aug 8 09:21:38.110905185 (23h41m37.700250203s) [upload=24541]: Starting upload Aug 8 09:21:38.110950653 (23h41m37.70029569s) [upload=24541]: Done starting upload Aug 8 09:21:38.110993394 (23h41m37.700338381s) [upload=24541]: Uploading segments... Aug 8 09:21:38.111023431 (23h41m37.700368418s) [upload=24541]: Got next segment. Inline: true Aug 8 09:21:38.111027930 (23h41m37.700372917s) [upload=24541]: Waiting for error group managing segments... Aug 8 09:21:38.111061304 (23h41m37.700406292s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:38.111065112 (23h41m37.700410099s) [upload=24541]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:38.111067396 (23h41m37.700412383s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:38.387315064 (23h41m37.976660051s) [upload=24541]: Done uploading segments... Aug 8 09:21:38.387330884 (23h41m37.976675872s) [upload=24541]: Upload finished. err: <nil> Aug 8 09:22:17.996454141 (23h42m17.585799128s) [upload=24551]: Starting upload Aug 8 09:22:17.996503356 (23h42m17.585848343s) [upload=24551]: Done starting upload Aug 8 09:22:17.996556327 (23h42m17.585901314s) [upload=24551]: Uploading segments... Aug 8 09:22:17.996589460 (23h42m17.585934437s) [upload=24551]: Got next segment. Inline: true Aug 8 09:22:17.996593097 (23h42m17.585938084s) [upload=24551]: Waiting for error group managing segments... Aug 8 09:22:17.996627753 (23h42m17.58597274s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:22:17.996632262 (23h42m17.585977249s) [upload=24551]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:22:17.996634697 (23h42m17.585979684s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:22:18.277062443 (23h42m17.86640743s) [upload=24551]: Done uploading segments... Aug 8 09:22:18.277091198 (23h42m17.866436185s) [upload=24551]: Upload finished. err: <nil> Aug 8 09:23:07.942999715 (23h43m7.532344702s) [upload=24564]: Starting upload Aug 8 09:23:07.943040163 (23h43m7.53238515s) [upload=24564]: Done starting upload Aug 8 09:23:07.943084257 (23h43m7.532429244s) [upload=24564]: Uploading segments... Aug 8 09:23:07.943114695 (23h43m7.532459683s) [upload=24564]: Got next segment. Inline: true Aug 8 09:23:07.943118182 (23h43m7.532463159s) [upload=24564]: Waiting for error group managing segments... Aug 8 09:23:07.943146797 (23h43m7.532491784s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:07.943150464 (23h43m7.532495451s) [upload=24564]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:07.943153469 (23h43m7.532498456s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:08.210168673 (23h43m7.79951366s) [upload=24564]: Done uploading segments... Aug 8 09:23:08.210185475 (23h43m7.799530462s) [upload=24564]: Upload finished. err: <nil> Aug 8 09:23:48.435052691 (23h43m48.024397678s) [upload=24575]: Starting upload Aug 8 09:23:48.435121553 (23h43m48.02446653s) [upload=24575]: Done starting upload Aug 8 09:23:48.435198760 (23h43m48.024543747s) [upload=24575]: Uploading segments... Aug 8 09:23:48.435270999 (23h43m48.024615976s) [upload=24575]: Got next segment. Inline: true Aug 8 09:23:48.435295846 (23h43m48.024640833s) [upload=24575]: Waiting for error group managing segments... Aug 8 09:23:48.435342055 (23h43m48.024687042s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:48.435346093 (23h43m48.02469108s) [upload=24575]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:48.435348587 (23h43m48.024693574s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:48.719102608 (23h43m48.308447585s) [upload=24575]: Done uploading segments... Aug 8 09:23:48.719117466 (23h43m48.308462453s) [upload=24575]: Upload finished. err: <nil> Aug 8 09:24:39.417540954 (23h44m39.006885942s) [upload=24586]: Starting upload Aug 8 09:24:39.417604145 (23h44m39.006949132s) [upload=24586]: Done starting upload Aug 8 09:24:39.417664560 (23h44m39.007009548s) [upload=24586]: Uploading segments... Aug 8 09:24:39.417706962 (23h44m39.007051949s) [upload=24586]: Got next segment. Inline: true Aug 8 09:24:39.417712482 (23h44m39.007057469s) [upload=24586]: Waiting for error group managing segments... Aug 8 09:24:39.417754242 (23h44m39.007099229s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:24:39.417759361 (23h44m39.007104348s) [upload=24586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:24:39.417762468 (23h44m39.007107455s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:24:39.686006082 (23h44m39.275351079s) [upload=24586]: Done uploading segments... Aug 8 09:24:39.686034888 (23h44m39.275379895s) [upload=24586]: Upload finished. err: <nil> Aug 8 09:25:37.249903605 (23h45m36.839248592s) [upload=24602]: Starting upload Aug 8 09:25:37.249946186 (23h45m36.839291173s) [upload=24602]: Done starting upload Aug 8 09:25:37.249997845 (23h45m36.839342832s) [upload=24602]: Uploading segments... Aug 8 09:25:37.250024005 (23h45m36.839368992s) [upload=24602]: Got next segment. Inline: true Aug 8 09:25:37.250027852 (23h45m36.839372839s) [upload=24602]: Waiting for error group managing segments... Aug 8 09:25:37.250059332 (23h45m36.839404319s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:25:37.250062999 (23h45m36.839407986s) [upload=24602]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:25:37.250065294 (23h45m36.839410281s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:25:37.535797089 (23h45m37.125142076s) [upload=24602]: Done uploading segments... Aug 8 09:25:37.535814202 (23h45m37.125159189s) [upload=24602]: Upload finished. err: <nil> Aug 8 09:26:08.125938011 (23h46m7.715282998s) [upload=24613]: Starting upload Aug 8 09:26:08.125982345 (23h46m7.715327332s) [upload=24613]: Done starting upload Aug 8 09:26:08.126028013 (23h46m7.715373s) [upload=24613]: Uploading segments... Aug 8 09:26:08.126054954 (23h46m7.715399941s) [upload=24613]: Got next segment. Inline: true Aug 8 09:26:08.126058461 (23h46m7.715403448s) [upload=24613]: Waiting for error group managing segments... Aug 8 09:26:08.126089620 (23h46m7.715434607s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:26:08.126093307 (23h46m7.715438294s) [upload=24613]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:26:08.126095511 (23h46m7.715440498s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:26:08.397979021 (23h46m7.987324008s) [upload=24613]: Done uploading segments... Aug 8 09:26:08.397997065 (23h46m7.987342052s) [upload=24613]: Upload finished. err: <nil> Duration: 1.816268792s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X....................................X......................] duration: 5.628315058s FAIL (2025-08-08 09:30:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.628337181s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [......X..X........................X......X...X.........X....] duration: 1.929827109s FAIL (2025-08-08 09:29:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== ) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Aug 8 09:19:50.816124617 (23h39m50.405469634s) [upload=24509]: Starting upload Aug 8 09:19:50.816190393 (23h39m50.4055354s) [upload=24509]: Done starting upload Aug 8 09:19:50.816260407 (23h39m50.405605414s) [upload=24509]: Uploading segments... Aug 8 09:19:50.816304711 (23h39m50.405649718s) [upload=24509]: Got next segment. Inline: true Aug 8 09:19:50.816310652 (23h39m50.40565566s) [upload=24509]: Waiting for error group managing segments... Aug 8 09:19:50.816354387 (23h39m50.405699374s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:19:50.816358344 (23h39m50.405703331s) [upload=24509]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:19:50.816360648 (23h39m50.405705625s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:19:51.094341032 (23h39m50.683686009s) [upload=24509]: Done uploading segments... Aug 8 09:19:51.094358025 (23h39m50.683703002s) [upload=24509]: Upload finished. err: <nil> Aug 8 09:20:47.238623223 (23h40m46.82796821s) [upload=24525]: Starting upload Aug 8 09:20:47.238678168 (23h40m46.828023145s) [upload=24525]: Done starting upload Aug 8 09:20:47.238798478 (23h40m46.828143466s) [upload=24525]: Uploading segments... Aug 8 09:20:47.238875896 (23h40m46.828220873s) [upload=24525]: Got next segment. Inline: true Aug 8 09:20:47.238880826 (23h40m46.828225813s) [upload=24525]: Waiting for error group managing segments... Aug 8 09:20:47.238922375 (23h40m46.828267352s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:20:47.238927194 (23h40m46.828272171s) [upload=24525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:20:47.238929619 (23h40m46.828274596s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:20:47.505079067 (23h40m47.094424054s) [upload=24525]: Done uploading segments... Aug 8 09:20:47.505096551 (23h40m47.094441538s) [upload=24525]: Upload finished. err: <nil> Aug 8 09:21:17.068435608 (23h41m16.657780595s) [upload=24534]: Starting upload Aug 8 09:21:17.068474893 (23h41m16.65781988s) [upload=24534]: Done starting upload Aug 8 09:21:17.068516683 (23h41m16.65786167s) [upload=24534]: Uploading segments... Aug 8 09:21:17.068545869 (23h41m16.657890846s) [upload=24534]: Got next segment. Inline: true Aug 8 09:21:17.068549796 (23h41m16.657894783s) [upload=24534]: Waiting for error group managing segments... Aug 8 09:21:17.068578140 (23h41m16.657923127s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:17.068581847 (23h41m16.657926834s) [upload=24534]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:17.068584202 (23h41m16.657929189s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:17.343299629 (23h41m16.932644616s) [upload=24534]: Done uploading segments... Aug 8 09:21:17.343319026 (23h41m16.932664013s) [upload=24534]: Upload finished. err: <nil> Aug 8 09:21:38.110905185 (23h41m37.700250203s) [upload=24541]: Starting upload Aug 8 09:21:38.110950653 (23h41m37.70029569s) [upload=24541]: Done starting upload Aug 8 09:21:38.110993394 (23h41m37.700338381s) [upload=24541]: Uploading segments... Aug 8 09:21:38.111023431 (23h41m37.700368418s) [upload=24541]: Got next segment. Inline: true Aug 8 09:21:38.111027930 (23h41m37.700372917s) [upload=24541]: Waiting for error group managing segments... Aug 8 09:21:38.111061304 (23h41m37.700406292s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:38.111065112 (23h41m37.700410099s) [upload=24541]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:38.111067396 (23h41m37.700412383s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:38.387315064 (23h41m37.976660051s) [upload=24541]: Done uploading segments... Aug 8 09:21:38.387330884 (23h41m37.976675872s) [upload=24541]: Upload finished. err: <nil> Aug 8 09:22:17.996454141 (23h42m17.585799128s) [upload=24551]: Starting upload Aug 8 09:22:17.996503356 (23h42m17.585848343s) [upload=24551]: Done starting upload Aug 8 09:22:17.996556327 (23h42m17.585901314s) [upload=24551]: Uploading segments... Aug 8 09:22:17.996589460 (23h42m17.585934437s) [upload=24551]: Got next segment. Inline: true Aug 8 09:22:17.996593097 (23h42m17.585938084s) [upload=24551]: Waiting for error group managing segments... Aug 8 09:22:17.996627753 (23h42m17.58597274s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:22:17.996632262 (23h42m17.585977249s) [upload=24551]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:22:17.996634697 (23h42m17.585979684s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:22:18.277062443 (23h42m17.86640743s) [upload=24551]: Done uploading segments... Aug 8 09:22:18.277091198 (23h42m17.866436185s) [upload=24551]: Upload finished. err: <nil> Aug 8 09:23:07.942999715 (23h43m7.532344702s) [upload=24564]: Starting upload Aug 8 09:23:07.943040163 (23h43m7.53238515s) [upload=24564]: Done starting upload Aug 8 09:23:07.943084257 (23h43m7.532429244s) [upload=24564]: Uploading segments... Aug 8 09:23:07.943114695 (23h43m7.532459683s) [upload=24564]: Got next segment. Inline: true Aug 8 09:23:07.943118182 (23h43m7.532463159s) [upload=24564]: Waiting for error group managing segments... Aug 8 09:23:07.943146797 (23h43m7.532491784s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:07.943150464 (23h43m7.532495451s) [upload=24564]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:07.943153469 (23h43m7.532498456s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:08.210168673 (23h43m7.79951366s) [upload=24564]: Done uploading segments... Aug 8 09:23:08.210185475 (23h43m7.799530462s) [upload=24564]: Upload finished. err: <nil> Aug 8 09:23:48.435052691 (23h43m48.024397678s) [upload=24575]: Starting upload Aug 8 09:23:48.435121553 (23h43m48.02446653s) [upload=24575]: Done starting upload Aug 8 09:23:48.435198760 (23h43m48.024543747s) [upload=24575]: Uploading segments... Aug 8 09:23:48.435270999 (23h43m48.024615976s) [upload=24575]: Got next segment. Inline: true Aug 8 09:23:48.435295846 (23h43m48.024640833s) [upload=24575]: Waiting for error group managing segments... Aug 8 09:23:48.435342055 (23h43m48.024687042s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:48.435346093 (23h43m48.02469108s) [upload=24575]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:48.435348587 (23h43m48.024693574s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:48.719102608 (23h43m48.308447585s) [upload=24575]: Done uploading segments... Aug 8 09:23:48.719117466 (23h43m48.308462453s) [upload=24575]: Upload finished. err: <nil> Aug 8 09:24:39.417540954 (23h44m39.006885942s) [upload=24586]: Starting upload Aug 8 09:24:39.417604145 (23h44m39.006949132s) [upload=24586]: Done starting upload Aug 8 09:24:39.417664560 (23h44m39.007009548s) [upload=24586]: Uploading segments... Aug 8 09:24:39.417706962 (23h44m39.007051949s) [upload=24586]: Got next segment. Inline: true Aug 8 09:24:39.417712482 (23h44m39.007057469s) [upload=24586]: Waiting for error group managing segments... Aug 8 09:24:39.417754242 (23h44m39.007099229s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:24:39.417759361 (23h44m39.007104348s) [upload=24586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:24:39.417762468 (23h44m39.007107455s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:24:39.686006082 (23h44m39.275351079s) [upload=24586]: Done uploading segments... Aug 8 09:24:39.686034888 (23h44m39.275379895s) [upload=24586]: Upload finished. err: <nil> Aug 8 09:25:37.249903605 (23h45m36.839248592s) [upload=24602]: Starting upload Aug 8 09:25:37.249946186 (23h45m36.839291173s) [upload=24602]: Done starting upload Aug 8 09:25:37.249997845 (23h45m36.839342832s) [upload=24602]: Uploading segments... Aug 8 09:25:37.250024005 (23h45m36.839368992s) [upload=24602]: Got next segment. Inline: true Aug 8 09:25:37.250027852 (23h45m36.839372839s) [upload=24602]: Waiting for error group managing segments... Aug 8 09:25:37.250059332 (23h45m36.839404319s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:25:37.250062999 (23h45m36.839407986s) [upload=24602]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:25:37.250065294 (23h45m36.839410281s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:25:37.535797089 (23h45m37.125142076s) [upload=24602]: Done uploading segments... Aug 8 09:25:37.535814202 (23h45m37.125159189s) [upload=24602]: Upload finished. err: <nil> Aug 8 09:26:08.125938011 (23h46m7.715282998s) [upload=24613]: Starting upload Aug 8 09:26:08.125982345 (23h46m7.715327332s) [upload=24613]: Done starting upload Aug 8 09:26:08.126028013 (23h46m7.715373s) [upload=24613]: Uploading segments... Aug 8 09:26:08.126054954 (23h46m7.715399941s) [upload=24613]: Got next segment. Inline: true Aug 8 09:26:08.126058461 (23h46m7.715403448s) [upload=24613]: Waiting for error group managing segments... Aug 8 09:26:08.126089620 (23h46m7.715434607s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:26:08.126093307 (23h46m7.715438294s) [upload=24613]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:26:08.126095511 (23h46m7.715440498s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:26:08.397979021 (23h46m7.987324008s) [upload=24613]: Done uploading segments... Aug 8 09:26:08.397997065 (23h46m7.987342052s) [upload=24613]: Upload finished. err: <nil> Duration: 1.929850362s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X....................................X.....................] duration: 5.573729839s FAIL (2025-08-08 09:29:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.573758946s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.......X..X........................X......X...X.........X...] duration: 1.812187277s FAIL (2025-08-08 09:28:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== ) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Aug 8 09:19:50.816124617 (23h39m50.405469634s) [upload=24509]: Starting upload Aug 8 09:19:50.816190393 (23h39m50.4055354s) [upload=24509]: Done starting upload Aug 8 09:19:50.816260407 (23h39m50.405605414s) [upload=24509]: Uploading segments... Aug 8 09:19:50.816304711 (23h39m50.405649718s) [upload=24509]: Got next segment. Inline: true Aug 8 09:19:50.816310652 (23h39m50.40565566s) [upload=24509]: Waiting for error group managing segments... Aug 8 09:19:50.816354387 (23h39m50.405699374s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:19:50.816358344 (23h39m50.405703331s) [upload=24509]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:19:50.816360648 (23h39m50.405705625s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:19:51.094341032 (23h39m50.683686009s) [upload=24509]: Done uploading segments... Aug 8 09:19:51.094358025 (23h39m50.683703002s) [upload=24509]: Upload finished. err: <nil> Aug 8 09:20:47.238623223 (23h40m46.82796821s) [upload=24525]: Starting upload Aug 8 09:20:47.238678168 (23h40m46.828023145s) [upload=24525]: Done starting upload Aug 8 09:20:47.238798478 (23h40m46.828143466s) [upload=24525]: Uploading segments... Aug 8 09:20:47.238875896 (23h40m46.828220873s) [upload=24525]: Got next segment. Inline: true Aug 8 09:20:47.238880826 (23h40m46.828225813s) [upload=24525]: Waiting for error group managing segments... Aug 8 09:20:47.238922375 (23h40m46.828267352s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:20:47.238927194 (23h40m46.828272171s) [upload=24525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:20:47.238929619 (23h40m46.828274596s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:20:47.505079067 (23h40m47.094424054s) [upload=24525]: Done uploading segments... Aug 8 09:20:47.505096551 (23h40m47.094441538s) [upload=24525]: Upload finished. err: <nil> Aug 8 09:21:17.068435608 (23h41m16.657780595s) [upload=24534]: Starting upload Aug 8 09:21:17.068474893 (23h41m16.65781988s) [upload=24534]: Done starting upload Aug 8 09:21:17.068516683 (23h41m16.65786167s) [upload=24534]: Uploading segments... Aug 8 09:21:17.068545869 (23h41m16.657890846s) [upload=24534]: Got next segment. Inline: true Aug 8 09:21:17.068549796 (23h41m16.657894783s) [upload=24534]: Waiting for error group managing segments... Aug 8 09:21:17.068578140 (23h41m16.657923127s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:17.068581847 (23h41m16.657926834s) [upload=24534]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:17.068584202 (23h41m16.657929189s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:17.343299629 (23h41m16.932644616s) [upload=24534]: Done uploading segments... Aug 8 09:21:17.343319026 (23h41m16.932664013s) [upload=24534]: Upload finished. err: <nil> Aug 8 09:21:38.110905185 (23h41m37.700250203s) [upload=24541]: Starting upload Aug 8 09:21:38.110950653 (23h41m37.70029569s) [upload=24541]: Done starting upload Aug 8 09:21:38.110993394 (23h41m37.700338381s) [upload=24541]: Uploading segments... Aug 8 09:21:38.111023431 (23h41m37.700368418s) [upload=24541]: Got next segment. Inline: true Aug 8 09:21:38.111027930 (23h41m37.700372917s) [upload=24541]: Waiting for error group managing segments... Aug 8 09:21:38.111061304 (23h41m37.700406292s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:38.111065112 (23h41m37.700410099s) [upload=24541]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:38.111067396 (23h41m37.700412383s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:38.387315064 (23h41m37.976660051s) [upload=24541]: Done uploading segments... Aug 8 09:21:38.387330884 (23h41m37.976675872s) [upload=24541]: Upload finished. err: <nil> Aug 8 09:22:17.996454141 (23h42m17.585799128s) [upload=24551]: Starting upload Aug 8 09:22:17.996503356 (23h42m17.585848343s) [upload=24551]: Done starting upload Aug 8 09:22:17.996556327 (23h42m17.585901314s) [upload=24551]: Uploading segments... Aug 8 09:22:17.996589460 (23h42m17.585934437s) [upload=24551]: Got next segment. Inline: true Aug 8 09:22:17.996593097 (23h42m17.585938084s) [upload=24551]: Waiting for error group managing segments... Aug 8 09:22:17.996627753 (23h42m17.58597274s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:22:17.996632262 (23h42m17.585977249s) [upload=24551]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:22:17.996634697 (23h42m17.585979684s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:22:18.277062443 (23h42m17.86640743s) [upload=24551]: Done uploading segments... Aug 8 09:22:18.277091198 (23h42m17.866436185s) [upload=24551]: Upload finished. err: <nil> Aug 8 09:23:07.942999715 (23h43m7.532344702s) [upload=24564]: Starting upload Aug 8 09:23:07.943040163 (23h43m7.53238515s) [upload=24564]: Done starting upload Aug 8 09:23:07.943084257 (23h43m7.532429244s) [upload=24564]: Uploading segments... Aug 8 09:23:07.943114695 (23h43m7.532459683s) [upload=24564]: Got next segment. Inline: true Aug 8 09:23:07.943118182 (23h43m7.532463159s) [upload=24564]: Waiting for error group managing segments... Aug 8 09:23:07.943146797 (23h43m7.532491784s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:07.943150464 (23h43m7.532495451s) [upload=24564]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:07.943153469 (23h43m7.532498456s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:08.210168673 (23h43m7.79951366s) [upload=24564]: Done uploading segments... Aug 8 09:23:08.210185475 (23h43m7.799530462s) [upload=24564]: Upload finished. err: <nil> Aug 8 09:23:48.435052691 (23h43m48.024397678s) [upload=24575]: Starting upload Aug 8 09:23:48.435121553 (23h43m48.02446653s) [upload=24575]: Done starting upload Aug 8 09:23:48.435198760 (23h43m48.024543747s) [upload=24575]: Uploading segments... Aug 8 09:23:48.435270999 (23h43m48.024615976s) [upload=24575]: Got next segment. Inline: true Aug 8 09:23:48.435295846 (23h43m48.024640833s) [upload=24575]: Waiting for error group managing segments... Aug 8 09:23:48.435342055 (23h43m48.024687042s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:48.435346093 (23h43m48.02469108s) [upload=24575]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:48.435348587 (23h43m48.024693574s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:48.719102608 (23h43m48.308447585s) [upload=24575]: Done uploading segments... Aug 8 09:23:48.719117466 (23h43m48.308462453s) [upload=24575]: Upload finished. err: <nil> Aug 8 09:24:39.417540954 (23h44m39.006885942s) [upload=24586]: Starting upload Aug 8 09:24:39.417604145 (23h44m39.006949132s) [upload=24586]: Done starting upload Aug 8 09:24:39.417664560 (23h44m39.007009548s) [upload=24586]: Uploading segments... Aug 8 09:24:39.417706962 (23h44m39.007051949s) [upload=24586]: Got next segment. Inline: true Aug 8 09:24:39.417712482 (23h44m39.007057469s) [upload=24586]: Waiting for error group managing segments... Aug 8 09:24:39.417754242 (23h44m39.007099229s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:24:39.417759361 (23h44m39.007104348s) [upload=24586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:24:39.417762468 (23h44m39.007107455s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:24:39.686006082 (23h44m39.275351079s) [upload=24586]: Done uploading segments... Aug 8 09:24:39.686034888 (23h44m39.275379895s) [upload=24586]: Upload finished. err: <nil> Aug 8 09:25:37.249903605 (23h45m36.839248592s) [upload=24602]: Starting upload Aug 8 09:25:37.249946186 (23h45m36.839291173s) [upload=24602]: Done starting upload Aug 8 09:25:37.249997845 (23h45m36.839342832s) [upload=24602]: Uploading segments... Aug 8 09:25:37.250024005 (23h45m36.839368992s) [upload=24602]: Got next segment. Inline: true Aug 8 09:25:37.250027852 (23h45m36.839372839s) [upload=24602]: Waiting for error group managing segments... Aug 8 09:25:37.250059332 (23h45m36.839404319s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:25:37.250062999 (23h45m36.839407986s) [upload=24602]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:25:37.250065294 (23h45m36.839410281s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:25:37.535797089 (23h45m37.125142076s) [upload=24602]: Done uploading segments... Aug 8 09:25:37.535814202 (23h45m37.125159189s) [upload=24602]: Upload finished. err: <nil> Aug 8 09:26:08.125938011 (23h46m7.715282998s) [upload=24613]: Starting upload Aug 8 09:26:08.125982345 (23h46m7.715327332s) [upload=24613]: Done starting upload Aug 8 09:26:08.126028013 (23h46m7.715373s) [upload=24613]: Uploading segments... Aug 8 09:26:08.126054954 (23h46m7.715399941s) [upload=24613]: Got next segment. Inline: true Aug 8 09:26:08.126058461 (23h46m7.715403448s) [upload=24613]: Waiting for error group managing segments... Aug 8 09:26:08.126089620 (23h46m7.715434607s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:26:08.126093307 (23h46m7.715438294s) [upload=24613]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:26:08.126095511 (23h46m7.715440498s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:26:08.397979021 (23h46m7.987324008s) [upload=24613]: Done uploading segments... Aug 8 09:26:08.397997065 (23h46m7.987342052s) [upload=24613]: Upload finished. err: <nil> Duration: 1.812214839s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X....................................X....................] duration: 5.611660455s FAIL (2025-08-08 09:28:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.611685382s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [........X..X........................X......X...X.........X..] duration: 1.855949366s FAIL (2025-08-08 09:27:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== ) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Aug 8 09:19:50.816124617 (23h39m50.405469634s) [upload=24509]: Starting upload Aug 8 09:19:50.816190393 (23h39m50.4055354s) [upload=24509]: Done starting upload Aug 8 09:19:50.816260407 (23h39m50.405605414s) [upload=24509]: Uploading segments... Aug 8 09:19:50.816304711 (23h39m50.405649718s) [upload=24509]: Got next segment. Inline: true Aug 8 09:19:50.816310652 (23h39m50.40565566s) [upload=24509]: Waiting for error group managing segments... Aug 8 09:19:50.816354387 (23h39m50.405699374s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:19:50.816358344 (23h39m50.405703331s) [upload=24509]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:19:50.816360648 (23h39m50.405705625s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:19:51.094341032 (23h39m50.683686009s) [upload=24509]: Done uploading segments... Aug 8 09:19:51.094358025 (23h39m50.683703002s) [upload=24509]: Upload finished. err: <nil> Aug 8 09:20:47.238623223 (23h40m46.82796821s) [upload=24525]: Starting upload Aug 8 09:20:47.238678168 (23h40m46.828023145s) [upload=24525]: Done starting upload Aug 8 09:20:47.238798478 (23h40m46.828143466s) [upload=24525]: Uploading segments... Aug 8 09:20:47.238875896 (23h40m46.828220873s) [upload=24525]: Got next segment. Inline: true Aug 8 09:20:47.238880826 (23h40m46.828225813s) [upload=24525]: Waiting for error group managing segments... Aug 8 09:20:47.238922375 (23h40m46.828267352s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:20:47.238927194 (23h40m46.828272171s) [upload=24525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:20:47.238929619 (23h40m46.828274596s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:20:47.505079067 (23h40m47.094424054s) [upload=24525]: Done uploading segments... Aug 8 09:20:47.505096551 (23h40m47.094441538s) [upload=24525]: Upload finished. err: <nil> Aug 8 09:21:17.068435608 (23h41m16.657780595s) [upload=24534]: Starting upload Aug 8 09:21:17.068474893 (23h41m16.65781988s) [upload=24534]: Done starting upload Aug 8 09:21:17.068516683 (23h41m16.65786167s) [upload=24534]: Uploading segments... Aug 8 09:21:17.068545869 (23h41m16.657890846s) [upload=24534]: Got next segment. Inline: true Aug 8 09:21:17.068549796 (23h41m16.657894783s) [upload=24534]: Waiting for error group managing segments... Aug 8 09:21:17.068578140 (23h41m16.657923127s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:17.068581847 (23h41m16.657926834s) [upload=24534]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:17.068584202 (23h41m16.657929189s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:17.343299629 (23h41m16.932644616s) [upload=24534]: Done uploading segments... Aug 8 09:21:17.343319026 (23h41m16.932664013s) [upload=24534]: Upload finished. err: <nil> Aug 8 09:21:38.110905185 (23h41m37.700250203s) [upload=24541]: Starting upload Aug 8 09:21:38.110950653 (23h41m37.70029569s) [upload=24541]: Done starting upload Aug 8 09:21:38.110993394 (23h41m37.700338381s) [upload=24541]: Uploading segments... Aug 8 09:21:38.111023431 (23h41m37.700368418s) [upload=24541]: Got next segment. Inline: true Aug 8 09:21:38.111027930 (23h41m37.700372917s) [upload=24541]: Waiting for error group managing segments... Aug 8 09:21:38.111061304 (23h41m37.700406292s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:38.111065112 (23h41m37.700410099s) [upload=24541]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:38.111067396 (23h41m37.700412383s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:38.387315064 (23h41m37.976660051s) [upload=24541]: Done uploading segments... Aug 8 09:21:38.387330884 (23h41m37.976675872s) [upload=24541]: Upload finished. err: <nil> Aug 8 09:22:17.996454141 (23h42m17.585799128s) [upload=24551]: Starting upload Aug 8 09:22:17.996503356 (23h42m17.585848343s) [upload=24551]: Done starting upload Aug 8 09:22:17.996556327 (23h42m17.585901314s) [upload=24551]: Uploading segments... Aug 8 09:22:17.996589460 (23h42m17.585934437s) [upload=24551]: Got next segment. Inline: true Aug 8 09:22:17.996593097 (23h42m17.585938084s) [upload=24551]: Waiting for error group managing segments... Aug 8 09:22:17.996627753 (23h42m17.58597274s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:22:17.996632262 (23h42m17.585977249s) [upload=24551]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:22:17.996634697 (23h42m17.585979684s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:22:18.277062443 (23h42m17.86640743s) [upload=24551]: Done uploading segments... Aug 8 09:22:18.277091198 (23h42m17.866436185s) [upload=24551]: Upload finished. err: <nil> Aug 8 09:23:07.942999715 (23h43m7.532344702s) [upload=24564]: Starting upload Aug 8 09:23:07.943040163 (23h43m7.53238515s) [upload=24564]: Done starting upload Aug 8 09:23:07.943084257 (23h43m7.532429244s) [upload=24564]: Uploading segments... Aug 8 09:23:07.943114695 (23h43m7.532459683s) [upload=24564]: Got next segment. Inline: true Aug 8 09:23:07.943118182 (23h43m7.532463159s) [upload=24564]: Waiting for error group managing segments... Aug 8 09:23:07.943146797 (23h43m7.532491784s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:07.943150464 (23h43m7.532495451s) [upload=24564]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:07.943153469 (23h43m7.532498456s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:08.210168673 (23h43m7.79951366s) [upload=24564]: Done uploading segments... Aug 8 09:23:08.210185475 (23h43m7.799530462s) [upload=24564]: Upload finished. err: <nil> Aug 8 09:23:48.435052691 (23h43m48.024397678s) [upload=24575]: Starting upload Aug 8 09:23:48.435121553 (23h43m48.02446653s) [upload=24575]: Done starting upload Aug 8 09:23:48.435198760 (23h43m48.024543747s) [upload=24575]: Uploading segments... Aug 8 09:23:48.435270999 (23h43m48.024615976s) [upload=24575]: Got next segment. Inline: true Aug 8 09:23:48.435295846 (23h43m48.024640833s) [upload=24575]: Waiting for error group managing segments... Aug 8 09:23:48.435342055 (23h43m48.024687042s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:48.435346093 (23h43m48.02469108s) [upload=24575]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:48.435348587 (23h43m48.024693574s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:48.719102608 (23h43m48.308447585s) [upload=24575]: Done uploading segments... Aug 8 09:23:48.719117466 (23h43m48.308462453s) [upload=24575]: Upload finished. err: <nil> Aug 8 09:24:39.417540954 (23h44m39.006885942s) [upload=24586]: Starting upload Aug 8 09:24:39.417604145 (23h44m39.006949132s) [upload=24586]: Done starting upload Aug 8 09:24:39.417664560 (23h44m39.007009548s) [upload=24586]: Uploading segments... Aug 8 09:24:39.417706962 (23h44m39.007051949s) [upload=24586]: Got next segment. Inline: true Aug 8 09:24:39.417712482 (23h44m39.007057469s) [upload=24586]: Waiting for error group managing segments... Aug 8 09:24:39.417754242 (23h44m39.007099229s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:24:39.417759361 (23h44m39.007104348s) [upload=24586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:24:39.417762468 (23h44m39.007107455s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:24:39.686006082 (23h44m39.275351079s) [upload=24586]: Done uploading segments... Aug 8 09:24:39.686034888 (23h44m39.275379895s) [upload=24586]: Upload finished. err: <nil> Aug 8 09:25:37.249903605 (23h45m36.839248592s) [upload=24602]: Starting upload Aug 8 09:25:37.249946186 (23h45m36.839291173s) [upload=24602]: Done starting upload Aug 8 09:25:37.249997845 (23h45m36.839342832s) [upload=24602]: Uploading segments... Aug 8 09:25:37.250024005 (23h45m36.839368992s) [upload=24602]: Got next segment. Inline: true Aug 8 09:25:37.250027852 (23h45m36.839372839s) [upload=24602]: Waiting for error group managing segments... Aug 8 09:25:37.250059332 (23h45m36.839404319s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:25:37.250062999 (23h45m36.839407986s) [upload=24602]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:25:37.250065294 (23h45m36.839410281s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:25:37.535797089 (23h45m37.125142076s) [upload=24602]: Done uploading segments... Aug 8 09:25:37.535814202 (23h45m37.125159189s) [upload=24602]: Upload finished. err: <nil> Aug 8 09:26:08.125938011 (23h46m7.715282998s) [upload=24613]: Starting upload Aug 8 09:26:08.125982345 (23h46m7.715327332s) [upload=24613]: Done starting upload Aug 8 09:26:08.126028013 (23h46m7.715373s) [upload=24613]: Uploading segments... Aug 8 09:26:08.126054954 (23h46m7.715399941s) [upload=24613]: Got next segment. Inline: true Aug 8 09:26:08.126058461 (23h46m7.715403448s) [upload=24613]: Waiting for error group managing segments... Aug 8 09:26:08.126089620 (23h46m7.715434607s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:26:08.126093307 (23h46m7.715438294s) [upload=24613]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:26:08.126095511 (23h46m7.715440498s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:26:08.397979021 (23h46m7.987324008s) [upload=24613]: Done uploading segments... Aug 8 09:26:08.397997065 (23h46m7.987342052s) [upload=24613]: Upload finished. err: <nil> Duration: 1.855975817s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X....................................X...................] duration: 5.717031934s FAIL (2025-08-08 09:27:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.717050871s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.........X..X........................X......X...X.........X.] duration: 1.848366558s FAIL (2025-08-08 09:27:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== ) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Aug 8 09:19:50.816124617 (23h39m50.405469634s) [upload=24509]: Starting upload Aug 8 09:19:50.816190393 (23h39m50.4055354s) [upload=24509]: Done starting upload Aug 8 09:19:50.816260407 (23h39m50.405605414s) [upload=24509]: Uploading segments... Aug 8 09:19:50.816304711 (23h39m50.405649718s) [upload=24509]: Got next segment. Inline: true Aug 8 09:19:50.816310652 (23h39m50.40565566s) [upload=24509]: Waiting for error group managing segments... Aug 8 09:19:50.816354387 (23h39m50.405699374s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:19:50.816358344 (23h39m50.405703331s) [upload=24509]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:19:50.816360648 (23h39m50.405705625s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:19:51.094341032 (23h39m50.683686009s) [upload=24509]: Done uploading segments... Aug 8 09:19:51.094358025 (23h39m50.683703002s) [upload=24509]: Upload finished. err: <nil> Aug 8 09:20:47.238623223 (23h40m46.82796821s) [upload=24525]: Starting upload Aug 8 09:20:47.238678168 (23h40m46.828023145s) [upload=24525]: Done starting upload Aug 8 09:20:47.238798478 (23h40m46.828143466s) [upload=24525]: Uploading segments... Aug 8 09:20:47.238875896 (23h40m46.828220873s) [upload=24525]: Got next segment. Inline: true Aug 8 09:20:47.238880826 (23h40m46.828225813s) [upload=24525]: Waiting for error group managing segments... Aug 8 09:20:47.238922375 (23h40m46.828267352s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:20:47.238927194 (23h40m46.828272171s) [upload=24525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:20:47.238929619 (23h40m46.828274596s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:20:47.505079067 (23h40m47.094424054s) [upload=24525]: Done uploading segments... Aug 8 09:20:47.505096551 (23h40m47.094441538s) [upload=24525]: Upload finished. err: <nil> Aug 8 09:21:17.068435608 (23h41m16.657780595s) [upload=24534]: Starting upload Aug 8 09:21:17.068474893 (23h41m16.65781988s) [upload=24534]: Done starting upload Aug 8 09:21:17.068516683 (23h41m16.65786167s) [upload=24534]: Uploading segments... Aug 8 09:21:17.068545869 (23h41m16.657890846s) [upload=24534]: Got next segment. Inline: true Aug 8 09:21:17.068549796 (23h41m16.657894783s) [upload=24534]: Waiting for error group managing segments... Aug 8 09:21:17.068578140 (23h41m16.657923127s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:17.068581847 (23h41m16.657926834s) [upload=24534]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:17.068584202 (23h41m16.657929189s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:17.343299629 (23h41m16.932644616s) [upload=24534]: Done uploading segments... Aug 8 09:21:17.343319026 (23h41m16.932664013s) [upload=24534]: Upload finished. err: <nil> Aug 8 09:21:38.110905185 (23h41m37.700250203s) [upload=24541]: Starting upload Aug 8 09:21:38.110950653 (23h41m37.70029569s) [upload=24541]: Done starting upload Aug 8 09:21:38.110993394 (23h41m37.700338381s) [upload=24541]: Uploading segments... Aug 8 09:21:38.111023431 (23h41m37.700368418s) [upload=24541]: Got next segment. Inline: true Aug 8 09:21:38.111027930 (23h41m37.700372917s) [upload=24541]: Waiting for error group managing segments... Aug 8 09:21:38.111061304 (23h41m37.700406292s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:38.111065112 (23h41m37.700410099s) [upload=24541]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:38.111067396 (23h41m37.700412383s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:38.387315064 (23h41m37.976660051s) [upload=24541]: Done uploading segments... Aug 8 09:21:38.387330884 (23h41m37.976675872s) [upload=24541]: Upload finished. err: <nil> Aug 8 09:22:17.996454141 (23h42m17.585799128s) [upload=24551]: Starting upload Aug 8 09:22:17.996503356 (23h42m17.585848343s) [upload=24551]: Done starting upload Aug 8 09:22:17.996556327 (23h42m17.585901314s) [upload=24551]: Uploading segments... Aug 8 09:22:17.996589460 (23h42m17.585934437s) [upload=24551]: Got next segment. Inline: true Aug 8 09:22:17.996593097 (23h42m17.585938084s) [upload=24551]: Waiting for error group managing segments... Aug 8 09:22:17.996627753 (23h42m17.58597274s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:22:17.996632262 (23h42m17.585977249s) [upload=24551]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:22:17.996634697 (23h42m17.585979684s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:22:18.277062443 (23h42m17.86640743s) [upload=24551]: Done uploading segments... Aug 8 09:22:18.277091198 (23h42m17.866436185s) [upload=24551]: Upload finished. err: <nil> Aug 8 09:23:07.942999715 (23h43m7.532344702s) [upload=24564]: Starting upload Aug 8 09:23:07.943040163 (23h43m7.53238515s) [upload=24564]: Done starting upload Aug 8 09:23:07.943084257 (23h43m7.532429244s) [upload=24564]: Uploading segments... Aug 8 09:23:07.943114695 (23h43m7.532459683s) [upload=24564]: Got next segment. Inline: true Aug 8 09:23:07.943118182 (23h43m7.532463159s) [upload=24564]: Waiting for error group managing segments... Aug 8 09:23:07.943146797 (23h43m7.532491784s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:07.943150464 (23h43m7.532495451s) [upload=24564]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:07.943153469 (23h43m7.532498456s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:08.210168673 (23h43m7.79951366s) [upload=24564]: Done uploading segments... Aug 8 09:23:08.210185475 (23h43m7.799530462s) [upload=24564]: Upload finished. err: <nil> Aug 8 09:23:48.435052691 (23h43m48.024397678s) [upload=24575]: Starting upload Aug 8 09:23:48.435121553 (23h43m48.02446653s) [upload=24575]: Done starting upload Aug 8 09:23:48.435198760 (23h43m48.024543747s) [upload=24575]: Uploading segments... Aug 8 09:23:48.435270999 (23h43m48.024615976s) [upload=24575]: Got next segment. Inline: true Aug 8 09:23:48.435295846 (23h43m48.024640833s) [upload=24575]: Waiting for error group managing segments... Aug 8 09:23:48.435342055 (23h43m48.024687042s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:48.435346093 (23h43m48.02469108s) [upload=24575]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:48.435348587 (23h43m48.024693574s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:48.719102608 (23h43m48.308447585s) [upload=24575]: Done uploading segments... Aug 8 09:23:48.719117466 (23h43m48.308462453s) [upload=24575]: Upload finished. err: <nil> Aug 8 09:24:39.417540954 (23h44m39.006885942s) [upload=24586]: Starting upload Aug 8 09:24:39.417604145 (23h44m39.006949132s) [upload=24586]: Done starting upload Aug 8 09:24:39.417664560 (23h44m39.007009548s) [upload=24586]: Uploading segments... Aug 8 09:24:39.417706962 (23h44m39.007051949s) [upload=24586]: Got next segment. Inline: true Aug 8 09:24:39.417712482 (23h44m39.007057469s) [upload=24586]: Waiting for error group managing segments... Aug 8 09:24:39.417754242 (23h44m39.007099229s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:24:39.417759361 (23h44m39.007104348s) [upload=24586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:24:39.417762468 (23h44m39.007107455s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:24:39.686006082 (23h44m39.275351079s) [upload=24586]: Done uploading segments... Aug 8 09:24:39.686034888 (23h44m39.275379895s) [upload=24586]: Upload finished. err: <nil> Aug 8 09:25:37.249903605 (23h45m36.839248592s) [upload=24602]: Starting upload Aug 8 09:25:37.249946186 (23h45m36.839291173s) [upload=24602]: Done starting upload Aug 8 09:25:37.249997845 (23h45m36.839342832s) [upload=24602]: Uploading segments... Aug 8 09:25:37.250024005 (23h45m36.839368992s) [upload=24602]: Got next segment. Inline: true Aug 8 09:25:37.250027852 (23h45m36.839372839s) [upload=24602]: Waiting for error group managing segments... Aug 8 09:25:37.250059332 (23h45m36.839404319s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:25:37.250062999 (23h45m36.839407986s) [upload=24602]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:25:37.250065294 (23h45m36.839410281s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:25:37.535797089 (23h45m37.125142076s) [upload=24602]: Done uploading segments... Aug 8 09:25:37.535814202 (23h45m37.125159189s) [upload=24602]: Upload finished. err: <nil> Aug 8 09:26:08.125938011 (23h46m7.715282998s) [upload=24613]: Starting upload Aug 8 09:26:08.125982345 (23h46m7.715327332s) [upload=24613]: Done starting upload Aug 8 09:26:08.126028013 (23h46m7.715373s) [upload=24613]: Uploading segments... Aug 8 09:26:08.126054954 (23h46m7.715399941s) [upload=24613]: Got next segment. Inline: true Aug 8 09:26:08.126058461 (23h46m7.715403448s) [upload=24613]: Waiting for error group managing segments... Aug 8 09:26:08.126089620 (23h46m7.715434607s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:26:08.126093307 (23h46m7.715438294s) [upload=24613]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:26:08.126095511 (23h46m7.715440498s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:26:08.397979021 (23h46m7.987324008s) [upload=24613]: Done uploading segments... Aug 8 09:26:08.397997065 (23h46m7.987342052s) [upload=24613]: Upload finished. err: <nil> Duration: 1.848400783s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..........X..X........................X......X...X.........X] duration: 1.582017299s FAIL (2025-08-08 09:26:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== ) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Aug 8 09:19:50.816124617 (23h39m50.405469634s) [upload=24509]: Starting upload Aug 8 09:19:50.816190393 (23h39m50.4055354s) [upload=24509]: Done starting upload Aug 8 09:19:50.816260407 (23h39m50.405605414s) [upload=24509]: Uploading segments... Aug 8 09:19:50.816304711 (23h39m50.405649718s) [upload=24509]: Got next segment. Inline: true Aug 8 09:19:50.816310652 (23h39m50.40565566s) [upload=24509]: Waiting for error group managing segments... Aug 8 09:19:50.816354387 (23h39m50.405699374s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:19:50.816358344 (23h39m50.405703331s) [upload=24509]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:19:50.816360648 (23h39m50.405705625s) [upload=24509]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:19:51.094341032 (23h39m50.683686009s) [upload=24509]: Done uploading segments... Aug 8 09:19:51.094358025 (23h39m50.683703002s) [upload=24509]: Upload finished. err: <nil> Aug 8 09:20:47.238623223 (23h40m46.82796821s) [upload=24525]: Starting upload Aug 8 09:20:47.238678168 (23h40m46.828023145s) [upload=24525]: Done starting upload Aug 8 09:20:47.238798478 (23h40m46.828143466s) [upload=24525]: Uploading segments... Aug 8 09:20:47.238875896 (23h40m46.828220873s) [upload=24525]: Got next segment. Inline: true Aug 8 09:20:47.238880826 (23h40m46.828225813s) [upload=24525]: Waiting for error group managing segments... Aug 8 09:20:47.238922375 (23h40m46.828267352s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:20:47.238927194 (23h40m46.828272171s) [upload=24525]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:20:47.238929619 (23h40m46.828274596s) [upload=24525]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:20:47.505079067 (23h40m47.094424054s) [upload=24525]: Done uploading segments... Aug 8 09:20:47.505096551 (23h40m47.094441538s) [upload=24525]: Upload finished. err: <nil> Aug 8 09:21:17.068435608 (23h41m16.657780595s) [upload=24534]: Starting upload Aug 8 09:21:17.068474893 (23h41m16.65781988s) [upload=24534]: Done starting upload Aug 8 09:21:17.068516683 (23h41m16.65786167s) [upload=24534]: Uploading segments... Aug 8 09:21:17.068545869 (23h41m16.657890846s) [upload=24534]: Got next segment. Inline: true Aug 8 09:21:17.068549796 (23h41m16.657894783s) [upload=24534]: Waiting for error group managing segments... Aug 8 09:21:17.068578140 (23h41m16.657923127s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:17.068581847 (23h41m16.657926834s) [upload=24534]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:17.068584202 (23h41m16.657929189s) [upload=24534]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:17.343299629 (23h41m16.932644616s) [upload=24534]: Done uploading segments... Aug 8 09:21:17.343319026 (23h41m16.932664013s) [upload=24534]: Upload finished. err: <nil> Aug 8 09:21:38.110905185 (23h41m37.700250203s) [upload=24541]: Starting upload Aug 8 09:21:38.110950653 (23h41m37.70029569s) [upload=24541]: Done starting upload Aug 8 09:21:38.110993394 (23h41m37.700338381s) [upload=24541]: Uploading segments... Aug 8 09:21:38.111023431 (23h41m37.700368418s) [upload=24541]: Got next segment. Inline: true Aug 8 09:21:38.111027930 (23h41m37.700372917s) [upload=24541]: Waiting for error group managing segments... Aug 8 09:21:38.111061304 (23h41m37.700406292s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:21:38.111065112 (23h41m37.700410099s) [upload=24541]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:21:38.111067396 (23h41m37.700412383s) [upload=24541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:21:38.387315064 (23h41m37.976660051s) [upload=24541]: Done uploading segments... Aug 8 09:21:38.387330884 (23h41m37.976675872s) [upload=24541]: Upload finished. err: <nil> Aug 8 09:22:17.996454141 (23h42m17.585799128s) [upload=24551]: Starting upload Aug 8 09:22:17.996503356 (23h42m17.585848343s) [upload=24551]: Done starting upload Aug 8 09:22:17.996556327 (23h42m17.585901314s) [upload=24551]: Uploading segments... Aug 8 09:22:17.996589460 (23h42m17.585934437s) [upload=24551]: Got next segment. Inline: true Aug 8 09:22:17.996593097 (23h42m17.585938084s) [upload=24551]: Waiting for error group managing segments... Aug 8 09:22:17.996627753 (23h42m17.58597274s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:22:17.996632262 (23h42m17.585977249s) [upload=24551]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:22:17.996634697 (23h42m17.585979684s) [upload=24551]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:22:18.277062443 (23h42m17.86640743s) [upload=24551]: Done uploading segments... Aug 8 09:22:18.277091198 (23h42m17.866436185s) [upload=24551]: Upload finished. err: <nil> Aug 8 09:23:07.942999715 (23h43m7.532344702s) [upload=24564]: Starting upload Aug 8 09:23:07.943040163 (23h43m7.53238515s) [upload=24564]: Done starting upload Aug 8 09:23:07.943084257 (23h43m7.532429244s) [upload=24564]: Uploading segments... Aug 8 09:23:07.943114695 (23h43m7.532459683s) [upload=24564]: Got next segment. Inline: true Aug 8 09:23:07.943118182 (23h43m7.532463159s) [upload=24564]: Waiting for error group managing segments... Aug 8 09:23:07.943146797 (23h43m7.532491784s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:07.943150464 (23h43m7.532495451s) [upload=24564]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:07.943153469 (23h43m7.532498456s) [upload=24564]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:08.210168673 (23h43m7.79951366s) [upload=24564]: Done uploading segments... Aug 8 09:23:08.210185475 (23h43m7.799530462s) [upload=24564]: Upload finished. err: <nil> Aug 8 09:23:48.435052691 (23h43m48.024397678s) [upload=24575]: Starting upload Aug 8 09:23:48.435121553 (23h43m48.02446653s) [upload=24575]: Done starting upload Aug 8 09:23:48.435198760 (23h43m48.024543747s) [upload=24575]: Uploading segments... Aug 8 09:23:48.435270999 (23h43m48.024615976s) [upload=24575]: Got next segment. Inline: true Aug 8 09:23:48.435295846 (23h43m48.024640833s) [upload=24575]: Waiting for error group managing segments... Aug 8 09:23:48.435342055 (23h43m48.024687042s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:23:48.435346093 (23h43m48.02469108s) [upload=24575]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:23:48.435348587 (23h43m48.024693574s) [upload=24575]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:23:48.719102608 (23h43m48.308447585s) [upload=24575]: Done uploading segments... Aug 8 09:23:48.719117466 (23h43m48.308462453s) [upload=24575]: Upload finished. err: <nil> Aug 8 09:24:39.417540954 (23h44m39.006885942s) [upload=24586]: Starting upload Aug 8 09:24:39.417604145 (23h44m39.006949132s) [upload=24586]: Done starting upload Aug 8 09:24:39.417664560 (23h44m39.007009548s) [upload=24586]: Uploading segments... Aug 8 09:24:39.417706962 (23h44m39.007051949s) [upload=24586]: Got next segment. Inline: true Aug 8 09:24:39.417712482 (23h44m39.007057469s) [upload=24586]: Waiting for error group managing segments... Aug 8 09:24:39.417754242 (23h44m39.007099229s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:24:39.417759361 (23h44m39.007104348s) [upload=24586]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:24:39.417762468 (23h44m39.007107455s) [upload=24586]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:24:39.686006082 (23h44m39.275351079s) [upload=24586]: Done uploading segments... Aug 8 09:24:39.686034888 (23h44m39.275379895s) [upload=24586]: Upload finished. err: <nil> Aug 8 09:25:37.249903605 (23h45m36.839248592s) [upload=24602]: Starting upload Aug 8 09:25:37.249946186 (23h45m36.839291173s) [upload=24602]: Done starting upload Aug 8 09:25:37.249997845 (23h45m36.839342832s) [upload=24602]: Uploading segments... Aug 8 09:25:37.250024005 (23h45m36.839368992s) [upload=24602]: Got next segment. Inline: true Aug 8 09:25:37.250027852 (23h45m36.839372839s) [upload=24602]: Waiting for error group managing segments... Aug 8 09:25:37.250059332 (23h45m36.839404319s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:25:37.250062999 (23h45m36.839407986s) [upload=24602]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:25:37.250065294 (23h45m36.839410281s) [upload=24602]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:25:37.535797089 (23h45m37.125142076s) [upload=24602]: Done uploading segments... Aug 8 09:25:37.535814202 (23h45m37.125159189s) [upload=24602]: Upload finished. err: <nil> Aug 8 09:26:08.125938011 (23h46m7.715282998s) [upload=24613]: Starting upload Aug 8 09:26:08.125982345 (23h46m7.715327332s) [upload=24613]: Done starting upload Aug 8 09:26:08.126028013 (23h46m7.715373s) [upload=24613]: Uploading segments... Aug 8 09:26:08.126054954 (23h46m7.715399941s) [upload=24613]: Got next segment. Inline: true Aug 8 09:26:08.126058461 (23h46m7.715403448s) [upload=24613]: Waiting for error group managing segments... Aug 8 09:26:08.126089620 (23h46m7.715434607s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:26:08.126093307 (23h46m7.715438294s) [upload=24613]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:26:08.126095511 (23h46m7.715440498s) [upload=24613]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:26:08.397979021 (23h46m7.987324008s) [upload=24613]: Done uploading segments... Aug 8 09:26:08.397997065 (23h46m7.987342052s) [upload=24613]: Upload finished. err: <nil> Duration: 1.582051132s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X....................................X..................] duration: 5.670318262s FAIL (2025-08-08 09:26:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.670345576s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...........X..X........................X......X...X.........] duration: 1.872756142s FAIL (2025-08-08 09:25:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:16:28.073635598 (23h36m27.662980585s) [upload=24453]: Starting upload Aug 8 09:16:28.073679251 (23h36m27.663024238s) [upload=24453]: Done starting upload Aug 8 09:16:28.073741059 (23h36m27.663086046s) [upload=24453]: Uploading segments... Aug 8 09:16:28.073780295 (23h36m27.663125272s) [upload=24453]: Got next segment. Inline: true Aug 8 09:16:28.073784783 (23h36m27.66312977s) [upload=24453]: Waiting for error group managing segments... Aug 8 09:16:28.073887069 (23h36m27.663232056s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.073890916 (23h36m27.663235903s) [upload=24453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.073893271 (23h36m27.663238258s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.339746292 (23h36m27.929091309s) [upload=24453]: Done uploading segments... Aug 8 09:16:28.339772131 (23h36m27.929117138s) [upload=24453]: Upload finished. err: <nil> Aug 8 09:17:05.285639745 (23h37m4.874984732s) [upload=24465]: Starting upload Aug 8 09:17:05.285701434 (23h37m4.875046431s) [upload=24465]: Done starting upload Aug 8 09:17:05.285762461 (23h37m4.875107448s) [upload=24465]: Uploading segments... Aug 8 09:17:05.285840911 (23h37m4.875185908s) [upload=24465]: Got next segment. Inline: true Aug 8 09:17:05.285846241 (23h37m4.875191228s) [upload=24465]: Waiting for error group managing segments... Aug 8 09:17:05.285890055 (23h37m4.875235042s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:05.285894984 (23h37m4.875239981s) [upload=24465]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:05.285898140 (23h37m4.875243127s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:05.553232074 (23h37m5.142577061s) [upload=24465]: Done uploading segments... Aug 8 09:17:05.553250508 (23h37m5.142595495s) [upload=24465]: Upload finished. err: <nil> Aug 8 09:17:54.301347673 (23h37m53.89069266s) [upload=24476]: Starting upload Aug 8 09:17:54.301395374 (23h37m53.890740361s) [upload=24476]: Done starting upload Aug 8 09:17:54.301448155 (23h37m53.890793152s) [upload=24476]: Uploading segments... Aug 8 09:17:54.301500144 (23h37m53.890845162s) [upload=24476]: Got next segment. Inline: true Aug 8 09:17:54.301511387 (23h37m53.890856404s) [upload=24476]: Waiting for error group managing segments... Aug 8 09:17:54.301559137 (23h37m53.890904194s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:54.301568295 (23h37m53.890913333s) [upload=24476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:54.301575499 (23h37m53.890920526s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:54.587638328 (23h37m54.176983315s) [upload=24476]: Done uploading segments... Aug 8 09:17:54.587654438 (23h37m54.176999415s) [upload=24476]: Upload finished. err: <nil> Aug 8 09:18:36.742524758 (23h38m36.331869735s) [upload=24488]: Starting upload Aug 8 09:18:36.742614529 (23h38m36.331959516s) [upload=24488]: Done starting upload Aug 8 09:18:36.742694432 (23h38m36.332039419s) [upload=24488]: Uploading segments... Aug 8 09:18:36.742734650 (23h38m36.332079647s) [upload=24488]: Got next segment. Inline: true Aug 8 09:18:36.742738657 (23h38m36.332083644s) [upload=24488]: Waiting for error group managing segments... Aug 8 09:18:36.742775648 (23h38m36.332120635s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:18:36.742779916 (23h38m36.332124903s) [upload=24488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:18:36.742782480 (23h38m36.332127467s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:18:37.011369192 (23h38m36.600714179s) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Duration: 1.872781891s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X....................................X.................] duration: 5.740851246s FAIL (2025-08-08 09:25:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.740877027s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [............X..X........................X......X...X........] duration: 1.833651155s FAIL (2025-08-08 09:24:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:16:28.073635598 (23h36m27.662980585s) [upload=24453]: Starting upload Aug 8 09:16:28.073679251 (23h36m27.663024238s) [upload=24453]: Done starting upload Aug 8 09:16:28.073741059 (23h36m27.663086046s) [upload=24453]: Uploading segments... Aug 8 09:16:28.073780295 (23h36m27.663125272s) [upload=24453]: Got next segment. Inline: true Aug 8 09:16:28.073784783 (23h36m27.66312977s) [upload=24453]: Waiting for error group managing segments... Aug 8 09:16:28.073887069 (23h36m27.663232056s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.073890916 (23h36m27.663235903s) [upload=24453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.073893271 (23h36m27.663238258s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.339746292 (23h36m27.929091309s) [upload=24453]: Done uploading segments... Aug 8 09:16:28.339772131 (23h36m27.929117138s) [upload=24453]: Upload finished. err: <nil> Aug 8 09:17:05.285639745 (23h37m4.874984732s) [upload=24465]: Starting upload Aug 8 09:17:05.285701434 (23h37m4.875046431s) [upload=24465]: Done starting upload Aug 8 09:17:05.285762461 (23h37m4.875107448s) [upload=24465]: Uploading segments... Aug 8 09:17:05.285840911 (23h37m4.875185908s) [upload=24465]: Got next segment. Inline: true Aug 8 09:17:05.285846241 (23h37m4.875191228s) [upload=24465]: Waiting for error group managing segments... Aug 8 09:17:05.285890055 (23h37m4.875235042s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:05.285894984 (23h37m4.875239981s) [upload=24465]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:05.285898140 (23h37m4.875243127s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:05.553232074 (23h37m5.142577061s) [upload=24465]: Done uploading segments... Aug 8 09:17:05.553250508 (23h37m5.142595495s) [upload=24465]: Upload finished. err: <nil> Aug 8 09:17:54.301347673 (23h37m53.89069266s) [upload=24476]: Starting upload Aug 8 09:17:54.301395374 (23h37m53.890740361s) [upload=24476]: Done starting upload Aug 8 09:17:54.301448155 (23h37m53.890793152s) [upload=24476]: Uploading segments... Aug 8 09:17:54.301500144 (23h37m53.890845162s) [upload=24476]: Got next segment. Inline: true Aug 8 09:17:54.301511387 (23h37m53.890856404s) [upload=24476]: Waiting for error group managing segments... Aug 8 09:17:54.301559137 (23h37m53.890904194s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:54.301568295 (23h37m53.890913333s) [upload=24476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:54.301575499 (23h37m53.890920526s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:54.587638328 (23h37m54.176983315s) [upload=24476]: Done uploading segments... Aug 8 09:17:54.587654438 (23h37m54.176999415s) [upload=24476]: Upload finished. err: <nil> Aug 8 09:18:36.742524758 (23h38m36.331869735s) [upload=24488]: Starting upload Aug 8 09:18:36.742614529 (23h38m36.331959516s) [upload=24488]: Done starting upload Aug 8 09:18:36.742694432 (23h38m36.332039419s) [upload=24488]: Uploading segments... Aug 8 09:18:36.742734650 (23h38m36.332079647s) [upload=24488]: Got next segment. Inline: true Aug 8 09:18:36.742738657 (23h38m36.332083644s) [upload=24488]: Waiting for error group managing segments... Aug 8 09:18:36.742775648 (23h38m36.332120635s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:18:36.742779916 (23h38m36.332124903s) [upload=24488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:18:36.742782480 (23h38m36.332127467s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:18:37.011369192 (23h38m36.600714179s) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Duration: 1.833676142s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X....................................X................] duration: 5.632576082s FAIL (2025-08-08 09:23:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.632607413s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.............X..X........................X......X...X.......] duration: 1.835859607s FAIL (2025-08-08 09:23:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:16:28.073635598 (23h36m27.662980585s) [upload=24453]: Starting upload Aug 8 09:16:28.073679251 (23h36m27.663024238s) [upload=24453]: Done starting upload Aug 8 09:16:28.073741059 (23h36m27.663086046s) [upload=24453]: Uploading segments... Aug 8 09:16:28.073780295 (23h36m27.663125272s) [upload=24453]: Got next segment. Inline: true Aug 8 09:16:28.073784783 (23h36m27.66312977s) [upload=24453]: Waiting for error group managing segments... Aug 8 09:16:28.073887069 (23h36m27.663232056s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.073890916 (23h36m27.663235903s) [upload=24453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.073893271 (23h36m27.663238258s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.339746292 (23h36m27.929091309s) [upload=24453]: Done uploading segments... Aug 8 09:16:28.339772131 (23h36m27.929117138s) [upload=24453]: Upload finished. err: <nil> Aug 8 09:17:05.285639745 (23h37m4.874984732s) [upload=24465]: Starting upload Aug 8 09:17:05.285701434 (23h37m4.875046431s) [upload=24465]: Done starting upload Aug 8 09:17:05.285762461 (23h37m4.875107448s) [upload=24465]: Uploading segments... Aug 8 09:17:05.285840911 (23h37m4.875185908s) [upload=24465]: Got next segment. Inline: true Aug 8 09:17:05.285846241 (23h37m4.875191228s) [upload=24465]: Waiting for error group managing segments... Aug 8 09:17:05.285890055 (23h37m4.875235042s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:05.285894984 (23h37m4.875239981s) [upload=24465]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:05.285898140 (23h37m4.875243127s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:05.553232074 (23h37m5.142577061s) [upload=24465]: Done uploading segments... Aug 8 09:17:05.553250508 (23h37m5.142595495s) [upload=24465]: Upload finished. err: <nil> Aug 8 09:17:54.301347673 (23h37m53.89069266s) [upload=24476]: Starting upload Aug 8 09:17:54.301395374 (23h37m53.890740361s) [upload=24476]: Done starting upload Aug 8 09:17:54.301448155 (23h37m53.890793152s) [upload=24476]: Uploading segments... Aug 8 09:17:54.301500144 (23h37m53.890845162s) [upload=24476]: Got next segment. Inline: true Aug 8 09:17:54.301511387 (23h37m53.890856404s) [upload=24476]: Waiting for error group managing segments... Aug 8 09:17:54.301559137 (23h37m53.890904194s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:54.301568295 (23h37m53.890913333s) [upload=24476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:54.301575499 (23h37m53.890920526s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:54.587638328 (23h37m54.176983315s) [upload=24476]: Done uploading segments... Aug 8 09:17:54.587654438 (23h37m54.176999415s) [upload=24476]: Upload finished. err: <nil> Aug 8 09:18:36.742524758 (23h38m36.331869735s) [upload=24488]: Starting upload Aug 8 09:18:36.742614529 (23h38m36.331959516s) [upload=24488]: Done starting upload Aug 8 09:18:36.742694432 (23h38m36.332039419s) [upload=24488]: Uploading segments... Aug 8 09:18:36.742734650 (23h38m36.332079647s) [upload=24488]: Got next segment. Inline: true Aug 8 09:18:36.742738657 (23h38m36.332083644s) [upload=24488]: Waiting for error group managing segments... Aug 8 09:18:36.742775648 (23h38m36.332120635s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:18:36.742779916 (23h38m36.332124903s) [upload=24488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:18:36.742782480 (23h38m36.332127467s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:18:37.011369192 (23h38m36.600714179s) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Duration: 1.835879956s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..............X..X........................X......X...X......] duration: 1.818812502s FAIL (2025-08-08 09:23:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:16:28.073635598 (23h36m27.662980585s) [upload=24453]: Starting upload Aug 8 09:16:28.073679251 (23h36m27.663024238s) [upload=24453]: Done starting upload Aug 8 09:16:28.073741059 (23h36m27.663086046s) [upload=24453]: Uploading segments... Aug 8 09:16:28.073780295 (23h36m27.663125272s) [upload=24453]: Got next segment. Inline: true Aug 8 09:16:28.073784783 (23h36m27.66312977s) [upload=24453]: Waiting for error group managing segments... Aug 8 09:16:28.073887069 (23h36m27.663232056s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.073890916 (23h36m27.663235903s) [upload=24453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.073893271 (23h36m27.663238258s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.339746292 (23h36m27.929091309s) [upload=24453]: Done uploading segments... Aug 8 09:16:28.339772131 (23h36m27.929117138s) [upload=24453]: Upload finished. err: <nil> Aug 8 09:17:05.285639745 (23h37m4.874984732s) [upload=24465]: Starting upload Aug 8 09:17:05.285701434 (23h37m4.875046431s) [upload=24465]: Done starting upload Aug 8 09:17:05.285762461 (23h37m4.875107448s) [upload=24465]: Uploading segments... Aug 8 09:17:05.285840911 (23h37m4.875185908s) [upload=24465]: Got next segment. Inline: true Aug 8 09:17:05.285846241 (23h37m4.875191228s) [upload=24465]: Waiting for error group managing segments... Aug 8 09:17:05.285890055 (23h37m4.875235042s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:05.285894984 (23h37m4.875239981s) [upload=24465]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:05.285898140 (23h37m4.875243127s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:05.553232074 (23h37m5.142577061s) [upload=24465]: Done uploading segments... Aug 8 09:17:05.553250508 (23h37m5.142595495s) [upload=24465]: Upload finished. err: <nil> Aug 8 09:17:54.301347673 (23h37m53.89069266s) [upload=24476]: Starting upload Aug 8 09:17:54.301395374 (23h37m53.890740361s) [upload=24476]: Done starting upload Aug 8 09:17:54.301448155 (23h37m53.890793152s) [upload=24476]: Uploading segments... Aug 8 09:17:54.301500144 (23h37m53.890845162s) [upload=24476]: Got next segment. Inline: true Aug 8 09:17:54.301511387 (23h37m53.890856404s) [upload=24476]: Waiting for error group managing segments... Aug 8 09:17:54.301559137 (23h37m53.890904194s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:54.301568295 (23h37m53.890913333s) [upload=24476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:54.301575499 (23h37m53.890920526s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:54.587638328 (23h37m54.176983315s) [upload=24476]: Done uploading segments... Aug 8 09:17:54.587654438 (23h37m54.176999415s) [upload=24476]: Upload finished. err: <nil> Aug 8 09:18:36.742524758 (23h38m36.331869735s) [upload=24488]: Starting upload Aug 8 09:18:36.742614529 (23h38m36.331959516s) [upload=24488]: Done starting upload Aug 8 09:18:36.742694432 (23h38m36.332039419s) [upload=24488]: Uploading segments... Aug 8 09:18:36.742734650 (23h38m36.332079647s) [upload=24488]: Got next segment. Inline: true Aug 8 09:18:36.742738657 (23h38m36.332083644s) [upload=24488]: Waiting for error group managing segments... Aug 8 09:18:36.742775648 (23h38m36.332120635s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:18:36.742779916 (23h38m36.332124903s) [upload=24488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:18:36.742782480 (23h38m36.332127467s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:18:37.011369192 (23h38m36.600714179s) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Duration: 1.818857729s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X....................................X...............] duration: 5.76097864s FAIL (2025-08-08 09:22:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.761028566s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [X..............X..X........................X......X...X.....] duration: 1.84037645s FAIL (2025-08-08 09:22:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:16:28.073635598 (23h36m27.662980585s) [upload=24453]: Starting upload Aug 8 09:16:28.073679251 (23h36m27.663024238s) [upload=24453]: Done starting upload Aug 8 09:16:28.073741059 (23h36m27.663086046s) [upload=24453]: Uploading segments... Aug 8 09:16:28.073780295 (23h36m27.663125272s) [upload=24453]: Got next segment. Inline: true Aug 8 09:16:28.073784783 (23h36m27.66312977s) [upload=24453]: Waiting for error group managing segments... Aug 8 09:16:28.073887069 (23h36m27.663232056s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.073890916 (23h36m27.663235903s) [upload=24453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.073893271 (23h36m27.663238258s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.339746292 (23h36m27.929091309s) [upload=24453]: Done uploading segments... Aug 8 09:16:28.339772131 (23h36m27.929117138s) [upload=24453]: Upload finished. err: <nil> Aug 8 09:17:05.285639745 (23h37m4.874984732s) [upload=24465]: Starting upload Aug 8 09:17:05.285701434 (23h37m4.875046431s) [upload=24465]: Done starting upload Aug 8 09:17:05.285762461 (23h37m4.875107448s) [upload=24465]: Uploading segments... Aug 8 09:17:05.285840911 (23h37m4.875185908s) [upload=24465]: Got next segment. Inline: true Aug 8 09:17:05.285846241 (23h37m4.875191228s) [upload=24465]: Waiting for error group managing segments... Aug 8 09:17:05.285890055 (23h37m4.875235042s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:05.285894984 (23h37m4.875239981s) [upload=24465]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:05.285898140 (23h37m4.875243127s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:05.553232074 (23h37m5.142577061s) [upload=24465]: Done uploading segments... Aug 8 09:17:05.553250508 (23h37m5.142595495s) [upload=24465]: Upload finished. err: <nil> Aug 8 09:17:54.301347673 (23h37m53.89069266s) [upload=24476]: Starting upload Aug 8 09:17:54.301395374 (23h37m53.890740361s) [upload=24476]: Done starting upload Aug 8 09:17:54.301448155 (23h37m53.890793152s) [upload=24476]: Uploading segments... Aug 8 09:17:54.301500144 (23h37m53.890845162s) [upload=24476]: Got next segment. Inline: true Aug 8 09:17:54.301511387 (23h37m53.890856404s) [upload=24476]: Waiting for error group managing segments... Aug 8 09:17:54.301559137 (23h37m53.890904194s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:54.301568295 (23h37m53.890913333s) [upload=24476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:54.301575499 (23h37m53.890920526s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:54.587638328 (23h37m54.176983315s) [upload=24476]: Done uploading segments... Aug 8 09:17:54.587654438 (23h37m54.176999415s) [upload=24476]: Upload finished. err: <nil> Aug 8 09:18:36.742524758 (23h38m36.331869735s) [upload=24488]: Starting upload Aug 8 09:18:36.742614529 (23h38m36.331959516s) [upload=24488]: Done starting upload Aug 8 09:18:36.742694432 (23h38m36.332039419s) [upload=24488]: Uploading segments... Aug 8 09:18:36.742734650 (23h38m36.332079647s) [upload=24488]: Got next segment. Inline: true Aug 8 09:18:36.742738657 (23h38m36.332083644s) [upload=24488]: Waiting for error group managing segments... Aug 8 09:18:36.742775648 (23h38m36.332120635s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:18:36.742779916 (23h38m36.332124903s) [upload=24488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:18:36.742782480 (23h38m36.332127467s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:18:37.011369192 (23h38m36.600714179s) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Duration: 1.84040336s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X....................................X..............] duration: 5.58936898s FAIL (2025-08-08 09:21:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.589396793s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.X..............X..X........................X......X...X....] duration: 1.83315396s FAIL (2025-08-08 09:21:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:16:28.073635598 (23h36m27.662980585s) [upload=24453]: Starting upload Aug 8 09:16:28.073679251 (23h36m27.663024238s) [upload=24453]: Done starting upload Aug 8 09:16:28.073741059 (23h36m27.663086046s) [upload=24453]: Uploading segments... Aug 8 09:16:28.073780295 (23h36m27.663125272s) [upload=24453]: Got next segment. Inline: true Aug 8 09:16:28.073784783 (23h36m27.66312977s) [upload=24453]: Waiting for error group managing segments... Aug 8 09:16:28.073887069 (23h36m27.663232056s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.073890916 (23h36m27.663235903s) [upload=24453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.073893271 (23h36m27.663238258s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.339746292 (23h36m27.929091309s) [upload=24453]: Done uploading segments... Aug 8 09:16:28.339772131 (23h36m27.929117138s) [upload=24453]: Upload finished. err: <nil> Aug 8 09:17:05.285639745 (23h37m4.874984732s) [upload=24465]: Starting upload Aug 8 09:17:05.285701434 (23h37m4.875046431s) [upload=24465]: Done starting upload Aug 8 09:17:05.285762461 (23h37m4.875107448s) [upload=24465]: Uploading segments... Aug 8 09:17:05.285840911 (23h37m4.875185908s) [upload=24465]: Got next segment. Inline: true Aug 8 09:17:05.285846241 (23h37m4.875191228s) [upload=24465]: Waiting for error group managing segments... Aug 8 09:17:05.285890055 (23h37m4.875235042s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:05.285894984 (23h37m4.875239981s) [upload=24465]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:05.285898140 (23h37m4.875243127s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:05.553232074 (23h37m5.142577061s) [upload=24465]: Done uploading segments... Aug 8 09:17:05.553250508 (23h37m5.142595495s) [upload=24465]: Upload finished. err: <nil> Aug 8 09:17:54.301347673 (23h37m53.89069266s) [upload=24476]: Starting upload Aug 8 09:17:54.301395374 (23h37m53.890740361s) [upload=24476]: Done starting upload Aug 8 09:17:54.301448155 (23h37m53.890793152s) [upload=24476]: Uploading segments... Aug 8 09:17:54.301500144 (23h37m53.890845162s) [upload=24476]: Got next segment. Inline: true Aug 8 09:17:54.301511387 (23h37m53.890856404s) [upload=24476]: Waiting for error group managing segments... Aug 8 09:17:54.301559137 (23h37m53.890904194s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:54.301568295 (23h37m53.890913333s) [upload=24476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:54.301575499 (23h37m53.890920526s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:54.587638328 (23h37m54.176983315s) [upload=24476]: Done uploading segments... Aug 8 09:17:54.587654438 (23h37m54.176999415s) [upload=24476]: Upload finished. err: <nil> Aug 8 09:18:36.742524758 (23h38m36.331869735s) [upload=24488]: Starting upload Aug 8 09:18:36.742614529 (23h38m36.331959516s) [upload=24488]: Done starting upload Aug 8 09:18:36.742694432 (23h38m36.332039419s) [upload=24488]: Uploading segments... Aug 8 09:18:36.742734650 (23h38m36.332079647s) [upload=24488]: Got next segment. Inline: true Aug 8 09:18:36.742738657 (23h38m36.332083644s) [upload=24488]: Waiting for error group managing segments... Aug 8 09:18:36.742775648 (23h38m36.332120635s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:18:36.742779916 (23h38m36.332124903s) [upload=24488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:18:36.742782480 (23h38m36.332127467s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:18:37.011369192 (23h38m36.600714179s) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Duration: 1.833179559s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X....................................X.............] duration: 5.583773547s FAIL (2025-08-08 09:21:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.583799948s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..X..............X..X........................X......X...X...] duration: 1.830298538s FAIL (2025-08-08 09:21:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:16:28.073635598 (23h36m27.662980585s) [upload=24453]: Starting upload Aug 8 09:16:28.073679251 (23h36m27.663024238s) [upload=24453]: Done starting upload Aug 8 09:16:28.073741059 (23h36m27.663086046s) [upload=24453]: Uploading segments... Aug 8 09:16:28.073780295 (23h36m27.663125272s) [upload=24453]: Got next segment. Inline: true Aug 8 09:16:28.073784783 (23h36m27.66312977s) [upload=24453]: Waiting for error group managing segments... Aug 8 09:16:28.073887069 (23h36m27.663232056s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.073890916 (23h36m27.663235903s) [upload=24453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.073893271 (23h36m27.663238258s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.339746292 (23h36m27.929091309s) [upload=24453]: Done uploading segments... Aug 8 09:16:28.339772131 (23h36m27.929117138s) [upload=24453]: Upload finished. err: <nil> Aug 8 09:17:05.285639745 (23h37m4.874984732s) [upload=24465]: Starting upload Aug 8 09:17:05.285701434 (23h37m4.875046431s) [upload=24465]: Done starting upload Aug 8 09:17:05.285762461 (23h37m4.875107448s) [upload=24465]: Uploading segments... Aug 8 09:17:05.285840911 (23h37m4.875185908s) [upload=24465]: Got next segment. Inline: true Aug 8 09:17:05.285846241 (23h37m4.875191228s) [upload=24465]: Waiting for error group managing segments... Aug 8 09:17:05.285890055 (23h37m4.875235042s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:05.285894984 (23h37m4.875239981s) [upload=24465]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:05.285898140 (23h37m4.875243127s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:05.553232074 (23h37m5.142577061s) [upload=24465]: Done uploading segments... Aug 8 09:17:05.553250508 (23h37m5.142595495s) [upload=24465]: Upload finished. err: <nil> Aug 8 09:17:54.301347673 (23h37m53.89069266s) [upload=24476]: Starting upload Aug 8 09:17:54.301395374 (23h37m53.890740361s) [upload=24476]: Done starting upload Aug 8 09:17:54.301448155 (23h37m53.890793152s) [upload=24476]: Uploading segments... Aug 8 09:17:54.301500144 (23h37m53.890845162s) [upload=24476]: Got next segment. Inline: true Aug 8 09:17:54.301511387 (23h37m53.890856404s) [upload=24476]: Waiting for error group managing segments... Aug 8 09:17:54.301559137 (23h37m53.890904194s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:54.301568295 (23h37m53.890913333s) [upload=24476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:54.301575499 (23h37m53.890920526s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:54.587638328 (23h37m54.176983315s) [upload=24476]: Done uploading segments... Aug 8 09:17:54.587654438 (23h37m54.176999415s) [upload=24476]: Upload finished. err: <nil> Aug 8 09:18:36.742524758 (23h38m36.331869735s) [upload=24488]: Starting upload Aug 8 09:18:36.742614529 (23h38m36.331959516s) [upload=24488]: Done starting upload Aug 8 09:18:36.742694432 (23h38m36.332039419s) [upload=24488]: Uploading segments... Aug 8 09:18:36.742734650 (23h38m36.332079647s) [upload=24488]: Got next segment. Inline: true Aug 8 09:18:36.742738657 (23h38m36.332083644s) [upload=24488]: Waiting for error group managing segments... Aug 8 09:18:36.742775648 (23h38m36.332120635s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:18:36.742779916 (23h38m36.332124903s) [upload=24488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:18:36.742782480 (23h38m36.332127467s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:18:37.011369192 (23h38m36.600714179s) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Duration: 1.830327262s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [...X..............X..X........................X......X...X..] duration: 1.82831892s FAIL (2025-08-08 09:20:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:16:28.073635598 (23h36m27.662980585s) [upload=24453]: Starting upload Aug 8 09:16:28.073679251 (23h36m27.663024238s) [upload=24453]: Done starting upload Aug 8 09:16:28.073741059 (23h36m27.663086046s) [upload=24453]: Uploading segments... Aug 8 09:16:28.073780295 (23h36m27.663125272s) [upload=24453]: Got next segment. Inline: true Aug 8 09:16:28.073784783 (23h36m27.66312977s) [upload=24453]: Waiting for error group managing segments... Aug 8 09:16:28.073887069 (23h36m27.663232056s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.073890916 (23h36m27.663235903s) [upload=24453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.073893271 (23h36m27.663238258s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.339746292 (23h36m27.929091309s) [upload=24453]: Done uploading segments... Aug 8 09:16:28.339772131 (23h36m27.929117138s) [upload=24453]: Upload finished. err: <nil> Aug 8 09:17:05.285639745 (23h37m4.874984732s) [upload=24465]: Starting upload Aug 8 09:17:05.285701434 (23h37m4.875046431s) [upload=24465]: Done starting upload Aug 8 09:17:05.285762461 (23h37m4.875107448s) [upload=24465]: Uploading segments... Aug 8 09:17:05.285840911 (23h37m4.875185908s) [upload=24465]: Got next segment. Inline: true Aug 8 09:17:05.285846241 (23h37m4.875191228s) [upload=24465]: Waiting for error group managing segments... Aug 8 09:17:05.285890055 (23h37m4.875235042s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:05.285894984 (23h37m4.875239981s) [upload=24465]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:05.285898140 (23h37m4.875243127s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:05.553232074 (23h37m5.142577061s) [upload=24465]: Done uploading segments... Aug 8 09:17:05.553250508 (23h37m5.142595495s) [upload=24465]: Upload finished. err: <nil> Aug 8 09:17:54.301347673 (23h37m53.89069266s) [upload=24476]: Starting upload Aug 8 09:17:54.301395374 (23h37m53.890740361s) [upload=24476]: Done starting upload Aug 8 09:17:54.301448155 (23h37m53.890793152s) [upload=24476]: Uploading segments... Aug 8 09:17:54.301500144 (23h37m53.890845162s) [upload=24476]: Got next segment. Inline: true Aug 8 09:17:54.301511387 (23h37m53.890856404s) [upload=24476]: Waiting for error group managing segments... Aug 8 09:17:54.301559137 (23h37m53.890904194s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:54.301568295 (23h37m53.890913333s) [upload=24476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:54.301575499 (23h37m53.890920526s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:54.587638328 (23h37m54.176983315s) [upload=24476]: Done uploading segments... Aug 8 09:17:54.587654438 (23h37m54.176999415s) [upload=24476]: Upload finished. err: <nil> Aug 8 09:18:36.742524758 (23h38m36.331869735s) [upload=24488]: Starting upload Aug 8 09:18:36.742614529 (23h38m36.331959516s) [upload=24488]: Done starting upload Aug 8 09:18:36.742694432 (23h38m36.332039419s) [upload=24488]: Uploading segments... Aug 8 09:18:36.742734650 (23h38m36.332079647s) [upload=24488]: Got next segment. Inline: true Aug 8 09:18:36.742738657 (23h38m36.332083644s) [upload=24488]: Waiting for error group managing segments... Aug 8 09:18:36.742775648 (23h38m36.332120635s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:18:36.742779916 (23h38m36.332124903s) [upload=24488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:18:36.742782480 (23h38m36.332127467s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:18:37.011369192 (23h38m36.600714179s) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Duration: 1.828337926s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X....................................X............] duration: 5.760928646s FAIL (2025-08-08 09:20:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.760955636s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [....X..............X..X........................X......X...X.] duration: 1.829325955s FAIL (2025-08-08 09:19:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:16:28.073635598 (23h36m27.662980585s) [upload=24453]: Starting upload Aug 8 09:16:28.073679251 (23h36m27.663024238s) [upload=24453]: Done starting upload Aug 8 09:16:28.073741059 (23h36m27.663086046s) [upload=24453]: Uploading segments... Aug 8 09:16:28.073780295 (23h36m27.663125272s) [upload=24453]: Got next segment. Inline: true Aug 8 09:16:28.073784783 (23h36m27.66312977s) [upload=24453]: Waiting for error group managing segments... Aug 8 09:16:28.073887069 (23h36m27.663232056s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.073890916 (23h36m27.663235903s) [upload=24453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.073893271 (23h36m27.663238258s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.339746292 (23h36m27.929091309s) [upload=24453]: Done uploading segments... Aug 8 09:16:28.339772131 (23h36m27.929117138s) [upload=24453]: Upload finished. err: <nil> Aug 8 09:17:05.285639745 (23h37m4.874984732s) [upload=24465]: Starting upload Aug 8 09:17:05.285701434 (23h37m4.875046431s) [upload=24465]: Done starting upload Aug 8 09:17:05.285762461 (23h37m4.875107448s) [upload=24465]: Uploading segments... Aug 8 09:17:05.285840911 (23h37m4.875185908s) [upload=24465]: Got next segment. Inline: true Aug 8 09:17:05.285846241 (23h37m4.875191228s) [upload=24465]: Waiting for error group managing segments... Aug 8 09:17:05.285890055 (23h37m4.875235042s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:05.285894984 (23h37m4.875239981s) [upload=24465]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:05.285898140 (23h37m4.875243127s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:05.553232074 (23h37m5.142577061s) [upload=24465]: Done uploading segments... Aug 8 09:17:05.553250508 (23h37m5.142595495s) [upload=24465]: Upload finished. err: <nil> Aug 8 09:17:54.301347673 (23h37m53.89069266s) [upload=24476]: Starting upload Aug 8 09:17:54.301395374 (23h37m53.890740361s) [upload=24476]: Done starting upload Aug 8 09:17:54.301448155 (23h37m53.890793152s) [upload=24476]: Uploading segments... Aug 8 09:17:54.301500144 (23h37m53.890845162s) [upload=24476]: Got next segment. Inline: true Aug 8 09:17:54.301511387 (23h37m53.890856404s) [upload=24476]: Waiting for error group managing segments... Aug 8 09:17:54.301559137 (23h37m53.890904194s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:54.301568295 (23h37m53.890913333s) [upload=24476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:54.301575499 (23h37m53.890920526s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:54.587638328 (23h37m54.176983315s) [upload=24476]: Done uploading segments... Aug 8 09:17:54.587654438 (23h37m54.176999415s) [upload=24476]: Upload finished. err: <nil> Aug 8 09:18:36.742524758 (23h38m36.331869735s) [upload=24488]: Starting upload Aug 8 09:18:36.742614529 (23h38m36.331959516s) [upload=24488]: Done starting upload Aug 8 09:18:36.742694432 (23h38m36.332039419s) [upload=24488]: Uploading segments... Aug 8 09:18:36.742734650 (23h38m36.332079647s) [upload=24488]: Got next segment. Inline: true Aug 8 09:18:36.742738657 (23h38m36.332083644s) [upload=24488]: Waiting for error group managing segments... Aug 8 09:18:36.742775648 (23h38m36.332120635s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:18:36.742779916 (23h38m36.332124903s) [upload=24488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:18:36.742782480 (23h38m36.332127467s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:18:37.011369192 (23h38m36.600714179s) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Duration: 1.829353739s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X....................................X...........] duration: 5.614374894s FAIL (2025-08-08 09:19:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.614398438s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X....................................X..........] duration: 5.737542199s FAIL (2025-08-08 09:18:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.737572077s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.....X..............X..X........................X......X...X] duration: 1.583278669s FAIL (2025-08-08 09:18:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:16:28.073635598 (23h36m27.662980585s) [upload=24453]: Starting upload Aug 8 09:16:28.073679251 (23h36m27.663024238s) [upload=24453]: Done starting upload Aug 8 09:16:28.073741059 (23h36m27.663086046s) [upload=24453]: Uploading segments... Aug 8 09:16:28.073780295 (23h36m27.663125272s) [upload=24453]: Got next segment. Inline: true Aug 8 09:16:28.073784783 (23h36m27.66312977s) [upload=24453]: Waiting for error group managing segments... Aug 8 09:16:28.073887069 (23h36m27.663232056s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:28.073890916 (23h36m27.663235903s) [upload=24453]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:28.073893271 (23h36m27.663238258s) [upload=24453]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:28.339746292 (23h36m27.929091309s) [upload=24453]: Done uploading segments... Aug 8 09:16:28.339772131 (23h36m27.929117138s) [upload=24453]: Upload finished. err: <nil> Aug 8 09:17:05.285639745 (23h37m4.874984732s) [upload=24465]: Starting upload Aug 8 09:17:05.285701434 (23h37m4.875046431s) [upload=24465]: Done starting upload Aug 8 09:17:05.285762461 (23h37m4.875107448s) [upload=24465]: Uploading segments... Aug 8 09:17:05.285840911 (23h37m4.875185908s) [upload=24465]: Got next segment. Inline: true Aug 8 09:17:05.285846241 (23h37m4.875191228s) [upload=24465]: Waiting for error group managing segments... Aug 8 09:17:05.285890055 (23h37m4.875235042s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:05.285894984 (23h37m4.875239981s) [upload=24465]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:05.285898140 (23h37m4.875243127s) [upload=24465]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:05.553232074 (23h37m5.142577061s) [upload=24465]: Done uploading segments... Aug 8 09:17:05.553250508 (23h37m5.142595495s) [upload=24465]: Upload finished. err: <nil> Aug 8 09:17:54.301347673 (23h37m53.89069266s) [upload=24476]: Starting upload Aug 8 09:17:54.301395374 (23h37m53.890740361s) [upload=24476]: Done starting upload Aug 8 09:17:54.301448155 (23h37m53.890793152s) [upload=24476]: Uploading segments... Aug 8 09:17:54.301500144 (23h37m53.890845162s) [upload=24476]: Got next segment. Inline: true Aug 8 09:17:54.301511387 (23h37m53.890856404s) [upload=24476]: Waiting for error group managing segments... Aug 8 09:17:54.301559137 (23h37m53.890904194s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:17:54.301568295 (23h37m53.890913333s) [upload=24476]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:17:54.301575499 (23h37m53.890920526s) [upload=24476]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:17:54.587638328 (23h37m54.176983315s) [upload=24476]: Done uploading segments... Aug 8 09:17:54.587654438 (23h37m54.176999415s) [upload=24476]: Upload finished. err: <nil> Aug 8 09:18:36.742524758 (23h38m36.331869735s) [upload=24488]: Starting upload Aug 8 09:18:36.742614529 (23h38m36.331959516s) [upload=24488]: Done starting upload Aug 8 09:18:36.742694432 (23h38m36.332039419s) [upload=24488]: Uploading segments... Aug 8 09:18:36.742734650 (23h38m36.332079647s) [upload=24488]: Got next segment. Inline: true Aug 8 09:18:36.742738657 (23h38m36.332083644s) [upload=24488]: Waiting for error group managing segments... Aug 8 09:18:36.742775648 (23h38m36.332120635s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:18:36.742779916 (23h38m36.332124903s) [upload=24488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:18:36.742782480 (23h38m36.332127467s) [upload=24488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:18:37.011369192 (23h38m36.600714179s) [upload=24488]: Done uploading segments... Aug 8 09:18:37.011432623 (23h38m36.60077761s) [upload=24488]: Upload finished. err: <nil> Duration: 1.583306613s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X....................................X.........] duration: 5.606754955s FAIL (2025-08-08 09:18:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.606782558s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [......X..............X..X........................X......X...] duration: 1.8702054s FAIL (2025-08-08 09:17:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 09:08:01.102301354 (23h28m0.691646341s) [upload=24310]: Upload finished. err: <nil> Aug 8 09:08:36.198637107 (23h28m35.787982094s) [upload=24321]: Starting upload Aug 8 09:08:36.198683246 (23h28m35.788028233s) [upload=24321]: Done starting upload Aug 8 09:08:36.198732059 (23h28m35.788077046s) [upload=24321]: Uploading segments... Aug 8 09:08:36.198762828 (23h28m35.788107815s) [upload=24321]: Got next segment. Inline: true Aug 8 09:08:36.198767036 (23h28m35.788112023s) [upload=24321]: Waiting for error group managing segments... Aug 8 09:08:36.198804087 (23h28m35.788149064s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:36.198808064 (23h28m35.788153051s) [upload=24321]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:36.198810579 (23h28m35.788155556s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:36.481859401 (23h28m36.071204378s) [upload=24321]: Done uploading segments... Aug 8 09:08:36.481876865 (23h28m36.071221852s) [upload=24321]: Upload finished. err: <nil> Aug 8 09:09:31.326588967 (23h29m30.915933954s) [upload=24333]: Starting upload Aug 8 09:09:31.326646547 (23h29m30.915991534s) [upload=24333]: Done starting upload Aug 8 09:09:31.326703516 (23h29m30.916048513s) [upload=24333]: Uploading segments... Aug 8 09:09:31.326740537 (23h29m30.916085524s) [upload=24333]: Got next segment. Inline: true Aug 8 09:09:31.326746218 (23h29m30.916091215s) [upload=24333]: Waiting for error group managing segments... Aug 8 09:09:31.326787266 (23h29m30.916132263s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:09:31.326792266 (23h29m30.916137253s) [upload=24333]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:09:31.326795482 (23h29m30.916140469s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:09:31.593342039 (23h29m31.182687026s) [upload=24333]: Done uploading segments... Aug 8 09:09:31.593361256 (23h29m31.182706243s) [upload=24333]: Upload finished. err: <nil> Aug 8 09:10:12.631543380 (23h30m12.220888367s) [upload=24346]: Starting upload Aug 8 09:10:12.631578136 (23h30m12.220923123s) [upload=24346]: Done starting upload Aug 8 09:10:12.631629504 (23h30m12.220974481s) [upload=24346]: Uploading segments... Aug 8 09:10:12.631656296 (23h30m12.221001283s) [upload=24346]: Got next segment. Inline: true Aug 8 09:10:12.631659311 (23h30m12.221004298s) [upload=24346]: Waiting for error group managing segments... Aug 8 09:10:12.631686563 (23h30m12.22103154s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.631690932 (23h30m12.221035919s) [upload=24346]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.631693126 (23h30m12.221038113s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.846075276 (23h30m12.435420263s) [upload=24346]: Done uploading segments... Aug 8 09:10:12.846094392 (23h30m12.435439379s) [upload=24346]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:11:16.485848427 (23h31m16.075193454s) [upload=24363]: Starting upload Aug 8 09:11:16.485956063 (23h31m16.07530105s) [upload=24363]: Done starting upload Aug 8 09:11:16.486011659 (23h31m16.075356646s) [upload=24363]: Uploading segments... Aug 8 09:11:16.486079580 (23h31m16.075424597s) [upload=24363]: Got next segment. Inline: true Aug 8 09:11:16.486087565 (23h31m16.075432572s) [upload=24363]: Waiting for error group managing segments... Aug 8 09:11:16.486145486 (23h31m16.075490523s) [upload=24363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:16.486155074 (23h31m16.075500111s) [upload=24363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:16.486160004 (23h31m16.075504991s) [upload=24363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:16.754007139 (23h31m16.343352127s) [upload=24363]: Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Duration: 1.870235889s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X....................................X........] duration: 5.542650153s FAIL (2025-08-08 09:17:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.542671704s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......X..............X..X........................X......X..] duration: 1.85433193s FAIL (2025-08-08 09:17:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 09:08:01.102301354 (23h28m0.691646341s) [upload=24310]: Upload finished. err: <nil> Aug 8 09:08:36.198637107 (23h28m35.787982094s) [upload=24321]: Starting upload Aug 8 09:08:36.198683246 (23h28m35.788028233s) [upload=24321]: Done starting upload Aug 8 09:08:36.198732059 (23h28m35.788077046s) [upload=24321]: Uploading segments... Aug 8 09:08:36.198762828 (23h28m35.788107815s) [upload=24321]: Got next segment. Inline: true Aug 8 09:08:36.198767036 (23h28m35.788112023s) [upload=24321]: Waiting for error group managing segments... Aug 8 09:08:36.198804087 (23h28m35.788149064s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:36.198808064 (23h28m35.788153051s) [upload=24321]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:36.198810579 (23h28m35.788155556s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:36.481859401 (23h28m36.071204378s) [upload=24321]: Done uploading segments... Aug 8 09:08:36.481876865 (23h28m36.071221852s) [upload=24321]: Upload finished. err: <nil> Aug 8 09:09:31.326588967 (23h29m30.915933954s) [upload=24333]: Starting upload Aug 8 09:09:31.326646547 (23h29m30.915991534s) [upload=24333]: Done starting upload Aug 8 09:09:31.326703516 (23h29m30.916048513s) [upload=24333]: Uploading segments... Aug 8 09:09:31.326740537 (23h29m30.916085524s) [upload=24333]: Got next segment. Inline: true Aug 8 09:09:31.326746218 (23h29m30.916091215s) [upload=24333]: Waiting for error group managing segments... Aug 8 09:09:31.326787266 (23h29m30.916132263s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:09:31.326792266 (23h29m30.916137253s) [upload=24333]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:09:31.326795482 (23h29m30.916140469s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:09:31.593342039 (23h29m31.182687026s) [upload=24333]: Done uploading segments... Aug 8 09:09:31.593361256 (23h29m31.182706243s) [upload=24333]: Upload finished. err: <nil> Aug 8 09:10:12.631543380 (23h30m12.220888367s) [upload=24346]: Starting upload Aug 8 09:10:12.631578136 (23h30m12.220923123s) [upload=24346]: Done starting upload Aug 8 09:10:12.631629504 (23h30m12.220974481s) [upload=24346]: Uploading segments... Aug 8 09:10:12.631656296 (23h30m12.221001283s) [upload=24346]: Got next segment. Inline: true Aug 8 09:10:12.631659311 (23h30m12.221004298s) [upload=24346]: Waiting for error group managing segments... Aug 8 09:10:12.631686563 (23h30m12.22103154s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.631690932 (23h30m12.221035919s) [upload=24346]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.631693126 (23h30m12.221038113s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.846075276 (23h30m12.435420263s) [upload=24346]: Done uploading segments... Aug 8 09:10:12.846094392 (23h30m12.435439379s) [upload=24346]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:11:16.485848427 (23h31m16.075193454s) [upload=24363]: Starting upload Aug 8 09:11:16.485956063 (23h31m16.07530105s) [upload=24363]: Done starting upload Aug 8 09:11:16.486011659 (23h31m16.075356646s) [upload=24363]: Uploading segments... Aug 8 09:11:16.486079580 (23h31m16.075424597s) [upload=24363]: Got next segment. Inline: true Aug 8 09:11:16.486087565 (23h31m16.075432572s) [upload=24363]: Waiting for error group managing segments... Aug 8 09:11:16.486145486 (23h31m16.075490523s) [upload=24363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:16.486155074 (23h31m16.075500111s) [upload=24363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:16.486160004 (23h31m16.075504991s) [upload=24363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:16.754007139 (23h31m16.343352127s) [upload=24363]: Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Duration: 1.854361305s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X....................................X.......] duration: 5.69274577s FAIL (2025-08-08 09:16:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.692776268s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [........X..............X..X........................X......X.] duration: 1.850803287s FAIL (2025-08-08 09:16:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 09:08:01.102301354 (23h28m0.691646341s) [upload=24310]: Upload finished. err: <nil> Aug 8 09:08:36.198637107 (23h28m35.787982094s) [upload=24321]: Starting upload Aug 8 09:08:36.198683246 (23h28m35.788028233s) [upload=24321]: Done starting upload Aug 8 09:08:36.198732059 (23h28m35.788077046s) [upload=24321]: Uploading segments... Aug 8 09:08:36.198762828 (23h28m35.788107815s) [upload=24321]: Got next segment. Inline: true Aug 8 09:08:36.198767036 (23h28m35.788112023s) [upload=24321]: Waiting for error group managing segments... Aug 8 09:08:36.198804087 (23h28m35.788149064s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:36.198808064 (23h28m35.788153051s) [upload=24321]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:36.198810579 (23h28m35.788155556s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:36.481859401 (23h28m36.071204378s) [upload=24321]: Done uploading segments... Aug 8 09:08:36.481876865 (23h28m36.071221852s) [upload=24321]: Upload finished. err: <nil> Aug 8 09:09:31.326588967 (23h29m30.915933954s) [upload=24333]: Starting upload Aug 8 09:09:31.326646547 (23h29m30.915991534s) [upload=24333]: Done starting upload Aug 8 09:09:31.326703516 (23h29m30.916048513s) [upload=24333]: Uploading segments... Aug 8 09:09:31.326740537 (23h29m30.916085524s) [upload=24333]: Got next segment. Inline: true Aug 8 09:09:31.326746218 (23h29m30.916091215s) [upload=24333]: Waiting for error group managing segments... Aug 8 09:09:31.326787266 (23h29m30.916132263s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:09:31.326792266 (23h29m30.916137253s) [upload=24333]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:09:31.326795482 (23h29m30.916140469s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:09:31.593342039 (23h29m31.182687026s) [upload=24333]: Done uploading segments... Aug 8 09:09:31.593361256 (23h29m31.182706243s) [upload=24333]: Upload finished. err: <nil> Aug 8 09:10:12.631543380 (23h30m12.220888367s) [upload=24346]: Starting upload Aug 8 09:10:12.631578136 (23h30m12.220923123s) [upload=24346]: Done starting upload Aug 8 09:10:12.631629504 (23h30m12.220974481s) [upload=24346]: Uploading segments... Aug 8 09:10:12.631656296 (23h30m12.221001283s) [upload=24346]: Got next segment. Inline: true Aug 8 09:10:12.631659311 (23h30m12.221004298s) [upload=24346]: Waiting for error group managing segments... Aug 8 09:10:12.631686563 (23h30m12.22103154s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.631690932 (23h30m12.221035919s) [upload=24346]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.631693126 (23h30m12.221038113s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.846075276 (23h30m12.435420263s) [upload=24346]: Done uploading segments... Aug 8 09:10:12.846094392 (23h30m12.435439379s) [upload=24346]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:11:16.485848427 (23h31m16.075193454s) [upload=24363]: Starting upload Aug 8 09:11:16.485956063 (23h31m16.07530105s) [upload=24363]: Done starting upload Aug 8 09:11:16.486011659 (23h31m16.075356646s) [upload=24363]: Uploading segments... Aug 8 09:11:16.486079580 (23h31m16.075424597s) [upload=24363]: Got next segment. Inline: true Aug 8 09:11:16.486087565 (23h31m16.075432572s) [upload=24363]: Waiting for error group managing segments... Aug 8 09:11:16.486145486 (23h31m16.075490523s) [upload=24363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:16.486155074 (23h31m16.075500111s) [upload=24363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:16.486160004 (23h31m16.075504991s) [upload=24363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:16.754007139 (23h31m16.343352127s) [upload=24363]: Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Duration: 1.850828925s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X....................................X......] duration: 5.571847358s FAIL (2025-08-08 09:16:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.571899849s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........X..............X..X........................X......X] duration: 858.674113ms FAIL (2025-08-08 09:16:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== 09:08:01.102301354 (23h28m0.691646341s) [upload=24310]: Upload finished. err: <nil> Aug 8 09:08:36.198637107 (23h28m35.787982094s) [upload=24321]: Starting upload Aug 8 09:08:36.198683246 (23h28m35.788028233s) [upload=24321]: Done starting upload Aug 8 09:08:36.198732059 (23h28m35.788077046s) [upload=24321]: Uploading segments... Aug 8 09:08:36.198762828 (23h28m35.788107815s) [upload=24321]: Got next segment. Inline: true Aug 8 09:08:36.198767036 (23h28m35.788112023s) [upload=24321]: Waiting for error group managing segments... Aug 8 09:08:36.198804087 (23h28m35.788149064s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:36.198808064 (23h28m35.788153051s) [upload=24321]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:36.198810579 (23h28m35.788155556s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:36.481859401 (23h28m36.071204378s) [upload=24321]: Done uploading segments... Aug 8 09:08:36.481876865 (23h28m36.071221852s) [upload=24321]: Upload finished. err: <nil> Aug 8 09:09:31.326588967 (23h29m30.915933954s) [upload=24333]: Starting upload Aug 8 09:09:31.326646547 (23h29m30.915991534s) [upload=24333]: Done starting upload Aug 8 09:09:31.326703516 (23h29m30.916048513s) [upload=24333]: Uploading segments... Aug 8 09:09:31.326740537 (23h29m30.916085524s) [upload=24333]: Got next segment. Inline: true Aug 8 09:09:31.326746218 (23h29m30.916091215s) [upload=24333]: Waiting for error group managing segments... Aug 8 09:09:31.326787266 (23h29m30.916132263s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:09:31.326792266 (23h29m30.916137253s) [upload=24333]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:09:31.326795482 (23h29m30.916140469s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:09:31.593342039 (23h29m31.182687026s) [upload=24333]: Done uploading segments... Aug 8 09:09:31.593361256 (23h29m31.182706243s) [upload=24333]: Upload finished. err: <nil> Aug 8 09:10:12.631543380 (23h30m12.220888367s) [upload=24346]: Starting upload Aug 8 09:10:12.631578136 (23h30m12.220923123s) [upload=24346]: Done starting upload Aug 8 09:10:12.631629504 (23h30m12.220974481s) [upload=24346]: Uploading segments... Aug 8 09:10:12.631656296 (23h30m12.221001283s) [upload=24346]: Got next segment. Inline: true Aug 8 09:10:12.631659311 (23h30m12.221004298s) [upload=24346]: Waiting for error group managing segments... Aug 8 09:10:12.631686563 (23h30m12.22103154s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.631690932 (23h30m12.221035919s) [upload=24346]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.631693126 (23h30m12.221038113s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.846075276 (23h30m12.435420263s) [upload=24346]: Done uploading segments... Aug 8 09:10:12.846094392 (23h30m12.435439379s) [upload=24346]: Upload finished. err: metaclient: Too Many Requests Aug 8 09:11:16.485848427 (23h31m16.075193454s) [upload=24363]: Starting upload Aug 8 09:11:16.485956063 (23h31m16.07530105s) [upload=24363]: Done starting upload Aug 8 09:11:16.486011659 (23h31m16.075356646s) [upload=24363]: Uploading segments... Aug 8 09:11:16.486079580 (23h31m16.075424597s) [upload=24363]: Got next segment. Inline: true Aug 8 09:11:16.486087565 (23h31m16.075432572s) [upload=24363]: Waiting for error group managing segments... Aug 8 09:11:16.486145486 (23h31m16.075490523s) [upload=24363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:11:16.486155074 (23h31m16.075500111s) [upload=24363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:11:16.486160004 (23h31m16.075504991s) [upload=24363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:11:16.754007139 (23h31m16.343352127s) [upload=24363]: Done uploading segments... Aug 8 09:11:16.754025374 (23h31m16.343370361s) [upload=24363]: Upload finished. err: <nil> Aug 8 09:12:26.426682773 (23h32m26.01602776s) [upload=24383]: Starting upload Aug 8 09:12:26.426736215 (23h32m26.016081202s) [upload=24383]: Done starting upload Aug 8 09:12:26.426799396 (23h32m26.016144383s) [upload=24383]: Uploading segments... Aug 8 09:12:26.426866525 (23h32m26.016211512s) [upload=24383]: Got next segment. Inline: true Aug 8 09:12:26.426871153 (23h32m26.01621614s) [upload=24383]: Waiting for error group managing segments... Aug 8 09:12:26.427047640 (23h32m26.016392628s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:26.427051688 (23h32m26.016396675s) [upload=24383]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:26.427055486 (23h32m26.016400473s) [upload=24383]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:26.744464439 (23h32m26.333809426s) [upload=24383]: Done uploading segments... Aug 8 09:12:26.744483185 (23h32m26.333828172s) [upload=24383]: Upload finished. err: <nil> Aug 8 09:12:59.397580933 (23h32m58.98692592s) [upload=24394]: Starting upload Aug 8 09:12:59.397623083 (23h32m58.98696807s) [upload=24394]: Done starting upload Aug 8 09:12:59.397698828 (23h32m58.987043815s) [upload=24394]: Uploading segments... Aug 8 09:12:59.397736741 (23h32m58.987081728s) [upload=24394]: Got next segment. Inline: true Aug 8 09:12:59.397740888 (23h32m58.987085875s) [upload=24394]: Waiting for error group managing segments... Aug 8 09:12:59.397777619 (23h32m58.987122606s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:12:59.397781727 (23h32m58.987126714s) [upload=24394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:12:59.397784663 (23h32m58.98712965s) [upload=24394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:12:59.666266063 (23h32m59.25561104s) [upload=24394]: Done uploading segments... Aug 8 09:12:59.666300328 (23h32m59.255645315s) [upload=24394]: Upload finished. err: <nil> Aug 8 09:14:05.517288495 (23h34m5.106633472s) [upload=24411]: Starting upload Aug 8 09:14:05.517335384 (23h34m5.106680371s) [upload=24411]: Done starting upload Aug 8 09:14:05.517386051 (23h34m5.106731038s) [upload=24411]: Uploading segments... Aug 8 09:14:05.517421699 (23h34m5.106766686s) [upload=24411]: Got next segment. Inline: true Aug 8 09:14:05.517425257 (23h34m5.106770234s) [upload=24411]: Waiting for error group managing segments... Aug 8 09:14:05.517460133 (23h34m5.106805121s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:05.517463870 (23h34m5.106808858s) [upload=24411]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:05.517466205 (23h34m5.106811192s) [upload=24411]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:05.786398015 (23h34m5.375743002s) [upload=24411]: Done uploading segments... Aug 8 09:14:05.786415529 (23h34m5.375760516s) [upload=24411]: Upload finished. err: <nil> Aug 8 09:14:35.458400907 (23h34m35.047745894s) [upload=24421]: Starting upload Aug 8 09:14:35.458445974 (23h34m35.047790951s) [upload=24421]: Done starting upload Aug 8 09:14:35.458489457 (23h34m35.047834444s) [upload=24421]: Uploading segments... Aug 8 09:14:35.458529764 (23h34m35.047874751s) [upload=24421]: Got next segment. Inline: true Aug 8 09:14:35.458533371 (23h34m35.047878358s) [upload=24421]: Waiting for error group managing segments... Aug 8 09:14:35.458566023 (23h34m35.047911s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:14:35.458571134 (23h34m35.047916121s) [upload=24421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:14:35.458573779 (23h34m35.047918766s) [upload=24421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:14:35.725842107 (23h34m35.315187094s) [upload=24421]: Done uploading segments... Aug 8 09:14:35.725859890 (23h34m35.315204877s) [upload=24421]: Upload finished. err: <nil> Aug 8 09:15:15.761188177 (23h35m15.350533164s) [upload=24433]: Starting upload Aug 8 09:15:15.761233544 (23h35m15.350578521s) [upload=24433]: Done starting upload Aug 8 09:15:15.761292787 (23h35m15.350637774s) [upload=24433]: Uploading segments... Aug 8 09:15:15.761333325 (23h35m15.350678312s) [upload=24433]: Got next segment. Inline: true Aug 8 09:15:15.761337393 (23h35m15.35068237s) [upload=24433]: Waiting for error group managing segments... Aug 8 09:15:15.761370286 (23h35m15.350715273s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:15:15.761373902 (23h35m15.350718889s) [upload=24433]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:15:15.761376187 (23h35m15.350721174s) [upload=24433]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:15:16.024338388 (23h35m15.613683375s) [upload=24433]: Done uploading segments... Aug 8 09:15:16.024351703 (23h35m15.61369669s) [upload=24433]: Upload finished. err: <nil> Aug 8 09:16:04.377835616 (23h36m3.967180603s) [upload=24446]: Starting upload Aug 8 09:16:04.377899097 (23h36m3.967244094s) [upload=24446]: Done starting upload Aug 8 09:16:04.377976024 (23h36m3.967321011s) [upload=24446]: Uploading segments... Aug 8 09:16:04.378058362 (23h36m3.967403349s) [upload=24446]: Got next segment. Inline: true Aug 8 09:16:04.378066307 (23h36m3.967411284s) [upload=24446]: Waiting for error group managing segments... Aug 8 09:16:04.378140579 (23h36m3.967485566s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:16:04.378147262 (23h36m3.967492259s) [upload=24446]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:16:04.378150950 (23h36m3.967495947s) [upload=24446]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:16:04.591204537 (23h36m4.180549524s) [upload=24446]: Done uploading segments... Aug 8 09:16:04.591221139 (23h36m4.180566126s) [upload=24446]: Upload finished. err: metaclient: Too Many Requests Duration: 858.704169ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X..............X..X........................X......] duration: 1.831404881s FAIL (2025-08-08 09:15:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== uploading segments... Aug 8 09:02:23.367907514 (23h22m22.957252501s) [upload=24213]: Upload finished. err: <nil> Aug 8 09:03:04.849369405 (23h23m4.438714392s) [upload=24222]: Starting upload Aug 8 09:03:04.849410853 (23h23m4.43875584s) [upload=24222]: Done starting upload Aug 8 09:03:04.849453145 (23h23m4.438798132s) [upload=24222]: Uploading segments... Aug 8 09:03:04.849489875 (23h23m4.438834892s) [upload=24222]: Got next segment. Inline: true Aug 8 09:03:04.849497329 (23h23m4.438842316s) [upload=24222]: Waiting for error group managing segments... Aug 8 09:03:04.849544659 (23h23m4.438889657s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:04.849550801 (23h23m4.438895818s) [upload=24222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:04.849557974 (23h23m4.438903002s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:05.205142106 (23h23m4.794487094s) [upload=24222]: Done uploading segments... Aug 8 09:03:05.205159701 (23h23m4.794504688s) [upload=24222]: Upload finished. err: <nil> Aug 8 09:03:31.827381913 (23h23m31.41672689s) [upload=24228]: Starting upload Aug 8 09:03:31.827450525 (23h23m31.416795512s) [upload=24228]: Done starting upload Aug 8 09:03:31.827498557 (23h23m31.416843534s) [upload=24228]: Uploading segments... Aug 8 09:03:31.827530538 (23h23m31.416875525s) [upload=24228]: Got next segment. Inline: true Aug 8 09:03:31.827534195 (23h23m31.416879182s) [upload=24228]: Waiting for error group managing segments... Aug 8 09:03:31.827565324 (23h23m31.416910312s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:31.827569041 (23h23m31.416914029s) [upload=24228]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:31.827571246 (23h23m31.416916233s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:32.104386551 (23h23m31.693731538s) [upload=24228]: Done uploading segments... Aug 8 09:03:32.104408623 (23h23m31.69375361s) [upload=24228]: Upload finished. err: <nil> Aug 8 09:04:43.145652766 (23h24m42.734997753s) [upload=24247]: Starting upload Aug 8 09:04:43.145734532 (23h24m42.73507952s) [upload=24247]: Done starting upload Aug 8 09:04:43.145853431 (23h24m42.735198418s) [upload=24247]: Uploading segments... Aug 8 09:04:43.145885432 (23h24m42.735230419s) [upload=24247]: Got next segment. Inline: true Aug 8 09:04:43.145889289 (23h24m42.735234276s) [upload=24247]: Waiting for error group managing segments... Aug 8 09:04:43.145934074 (23h24m42.735279051s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:04:43.145938093 (23h24m42.73528308s) [upload=24247]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:04:43.145940287 (23h24m42.735285264s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:04:43.422274420 (23h24m43.011619407s) [upload=24247]: Done uploading segments... Aug 8 09:04:43.422293056 (23h24m43.011638043s) [upload=24247]: Upload finished. err: <nil> Aug 8 09:05:31.091183161 (23h25m30.680528148s) [upload=24261]: Starting upload Aug 8 09:05:31.091257574 (23h25m30.680602561s) [upload=24261]: Done starting upload Aug 8 09:05:31.091378225 (23h25m30.680723213s) [upload=24261]: Uploading segments... Aug 8 09:05:31.091418482 (23h25m30.680763469s) [upload=24261]: Got next segment. Inline: true Aug 8 09:05:31.091422620 (23h25m30.680767597s) [upload=24261]: Waiting for error group managing segments... Aug 8 09:05:31.091459660 (23h25m30.680804637s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:31.091463338 (23h25m30.680808325s) [upload=24261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:31.091465803 (23h25m30.68081079s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:31.369905164 (23h25m30.959250151s) [upload=24261]: Done uploading segments... Aug 8 09:05:31.369927577 (23h25m30.959272575s) [upload=24261]: Upload finished. err: <nil> Aug 8 09:05:58.911609156 (23h25m58.500954143s) [upload=24270]: Starting upload Aug 8 09:05:58.911647900 (23h25m58.500992887s) [upload=24270]: Done starting upload Aug 8 09:05:58.911701302 (23h25m58.50104629s) [upload=24270]: Uploading segments... Aug 8 09:05:58.911733344 (23h25m58.501078331s) [upload=24270]: Got next segment. Inline: true Aug 8 09:05:58.911737231 (23h25m58.501082218s) [upload=24270]: Waiting for error group managing segments... Aug 8 09:05:58.911770514 (23h25m58.501115501s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:58.911774562 (23h25m58.501119549s) [upload=24270]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:58.911777338 (23h25m58.501122325s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:59.179929718 (23h25m58.769274695s) [upload=24270]: Done uploading segments... Aug 8 09:05:59.179950949 (23h25m58.769295936s) [upload=24270]: Upload finished. err: <nil> Aug 8 09:07:07.887277101 (23h27m7.476622088s) [upload=24294]: Starting upload Aug 8 09:07:07.887403684 (23h27m7.476748721s) [upload=24294]: Done starting upload Aug 8 09:07:07.887460572 (23h27m7.47680556s) [upload=24294]: Uploading segments... Aug 8 09:07:07.887493135 (23h27m7.476838122s) [upload=24294]: Got next segment. Inline: true Aug 8 09:07:07.887496842 (23h27m7.476841829s) [upload=24294]: Waiting for error group managing segments... Aug 8 09:07:07.887533232 (23h27m7.476878219s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:07:07.887537299 (23h27m7.476882287s) [upload=24294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:07:07.887541437 (23h27m7.476886424s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:07:08.159871109 (23h27m7.749216096s) [upload=24294]: Done uploading segments... Aug 8 09:07:08.159889454 (23h27m7.749234441s) [upload=24294]: Upload finished. err: <nil> Aug 8 09:08:00.823985128 (23h28m0.413330145s) [upload=24310]: Starting upload Aug 8 09:08:00.824046044 (23h28m0.413391031s) [upload=24310]: Done starting upload Aug 8 09:08:00.824106660 (23h28m0.413451647s) [upload=24310]: Uploading segments... Aug 8 09:08:00.824204177 (23h28m0.413549164s) [upload=24310]: Got next segment. Inline: true Aug 8 09:08:00.824208896 (23h28m0.413553883s) [upload=24310]: Waiting for error group managing segments... Aug 8 09:08:00.824261176 (23h28m0.413606163s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:00.824265544 (23h28m0.413610531s) [upload=24310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:00.824267758 (23h28m0.413612746s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:01.102285695 (23h28m0.691630682s) [upload=24310]: Done uploading segments... Aug 8 09:08:01.102301354 (23h28m0.691646341s) [upload=24310]: Upload finished. err: <nil> Aug 8 09:08:36.198637107 (23h28m35.787982094s) [upload=24321]: Starting upload Aug 8 09:08:36.198683246 (23h28m35.788028233s) [upload=24321]: Done starting upload Aug 8 09:08:36.198732059 (23h28m35.788077046s) [upload=24321]: Uploading segments... Aug 8 09:08:36.198762828 (23h28m35.788107815s) [upload=24321]: Got next segment. Inline: true Aug 8 09:08:36.198767036 (23h28m35.788112023s) [upload=24321]: Waiting for error group managing segments... Aug 8 09:08:36.198804087 (23h28m35.788149064s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:36.198808064 (23h28m35.788153051s) [upload=24321]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:36.198810579 (23h28m35.788155556s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:36.481859401 (23h28m36.071204378s) [upload=24321]: Done uploading segments... Aug 8 09:08:36.481876865 (23h28m36.071221852s) [upload=24321]: Upload finished. err: <nil> Aug 8 09:09:31.326588967 (23h29m30.915933954s) [upload=24333]: Starting upload Aug 8 09:09:31.326646547 (23h29m30.915991534s) [upload=24333]: Done starting upload Aug 8 09:09:31.326703516 (23h29m30.916048513s) [upload=24333]: Uploading segments... Aug 8 09:09:31.326740537 (23h29m30.916085524s) [upload=24333]: Got next segment. Inline: true Aug 8 09:09:31.326746218 (23h29m30.916091215s) [upload=24333]: Waiting for error group managing segments... Aug 8 09:09:31.326787266 (23h29m30.916132263s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:09:31.326792266 (23h29m30.916137253s) [upload=24333]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:09:31.326795482 (23h29m30.916140469s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:09:31.593342039 (23h29m31.182687026s) [upload=24333]: Done uploading segments... Aug 8 09:09:31.593361256 (23h29m31.182706243s) [upload=24333]: Upload finished. err: <nil> Aug 8 09:10:12.631543380 (23h30m12.220888367s) [upload=24346]: Starting upload Aug 8 09:10:12.631578136 (23h30m12.220923123s) [upload=24346]: Done starting upload Aug 8 09:10:12.631629504 (23h30m12.220974481s) [upload=24346]: Uploading segments... Aug 8 09:10:12.631656296 (23h30m12.221001283s) [upload=24346]: Got next segment. Inline: true Aug 8 09:10:12.631659311 (23h30m12.221004298s) [upload=24346]: Waiting for error group managing segments... Aug 8 09:10:12.631686563 (23h30m12.22103154s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.631690932 (23h30m12.221035919s) [upload=24346]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.631693126 (23h30m12.221038113s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.846075276 (23h30m12.435420263s) [upload=24346]: Done uploading segments... Aug 8 09:10:12.846094392 (23h30m12.435439379s) [upload=24346]: Upload finished. err: metaclient: Too Many Requests Duration: 1.83143045s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X....................................X.....] duration: 5.52172768s FAIL (2025-08-08 09:15:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.521753978s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X....................................X....] duration: 5.560846867s FAIL (2025-08-08 09:14:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.560875742s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........X..............X..X........................X.....] duration: 1.831827712s FAIL (2025-08-08 09:14:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== uploading segments... Aug 8 09:02:23.367907514 (23h22m22.957252501s) [upload=24213]: Upload finished. err: <nil> Aug 8 09:03:04.849369405 (23h23m4.438714392s) [upload=24222]: Starting upload Aug 8 09:03:04.849410853 (23h23m4.43875584s) [upload=24222]: Done starting upload Aug 8 09:03:04.849453145 (23h23m4.438798132s) [upload=24222]: Uploading segments... Aug 8 09:03:04.849489875 (23h23m4.438834892s) [upload=24222]: Got next segment. Inline: true Aug 8 09:03:04.849497329 (23h23m4.438842316s) [upload=24222]: Waiting for error group managing segments... Aug 8 09:03:04.849544659 (23h23m4.438889657s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:04.849550801 (23h23m4.438895818s) [upload=24222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:04.849557974 (23h23m4.438903002s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:05.205142106 (23h23m4.794487094s) [upload=24222]: Done uploading segments... Aug 8 09:03:05.205159701 (23h23m4.794504688s) [upload=24222]: Upload finished. err: <nil> Aug 8 09:03:31.827381913 (23h23m31.41672689s) [upload=24228]: Starting upload Aug 8 09:03:31.827450525 (23h23m31.416795512s) [upload=24228]: Done starting upload Aug 8 09:03:31.827498557 (23h23m31.416843534s) [upload=24228]: Uploading segments... Aug 8 09:03:31.827530538 (23h23m31.416875525s) [upload=24228]: Got next segment. Inline: true Aug 8 09:03:31.827534195 (23h23m31.416879182s) [upload=24228]: Waiting for error group managing segments... Aug 8 09:03:31.827565324 (23h23m31.416910312s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:31.827569041 (23h23m31.416914029s) [upload=24228]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:31.827571246 (23h23m31.416916233s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:32.104386551 (23h23m31.693731538s) [upload=24228]: Done uploading segments... Aug 8 09:03:32.104408623 (23h23m31.69375361s) [upload=24228]: Upload finished. err: <nil> Aug 8 09:04:43.145652766 (23h24m42.734997753s) [upload=24247]: Starting upload Aug 8 09:04:43.145734532 (23h24m42.73507952s) [upload=24247]: Done starting upload Aug 8 09:04:43.145853431 (23h24m42.735198418s) [upload=24247]: Uploading segments... Aug 8 09:04:43.145885432 (23h24m42.735230419s) [upload=24247]: Got next segment. Inline: true Aug 8 09:04:43.145889289 (23h24m42.735234276s) [upload=24247]: Waiting for error group managing segments... Aug 8 09:04:43.145934074 (23h24m42.735279051s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:04:43.145938093 (23h24m42.73528308s) [upload=24247]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:04:43.145940287 (23h24m42.735285264s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:04:43.422274420 (23h24m43.011619407s) [upload=24247]: Done uploading segments... Aug 8 09:04:43.422293056 (23h24m43.011638043s) [upload=24247]: Upload finished. err: <nil> Aug 8 09:05:31.091183161 (23h25m30.680528148s) [upload=24261]: Starting upload Aug 8 09:05:31.091257574 (23h25m30.680602561s) [upload=24261]: Done starting upload Aug 8 09:05:31.091378225 (23h25m30.680723213s) [upload=24261]: Uploading segments... Aug 8 09:05:31.091418482 (23h25m30.680763469s) [upload=24261]: Got next segment. Inline: true Aug 8 09:05:31.091422620 (23h25m30.680767597s) [upload=24261]: Waiting for error group managing segments... Aug 8 09:05:31.091459660 (23h25m30.680804637s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:31.091463338 (23h25m30.680808325s) [upload=24261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:31.091465803 (23h25m30.68081079s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:31.369905164 (23h25m30.959250151s) [upload=24261]: Done uploading segments... Aug 8 09:05:31.369927577 (23h25m30.959272575s) [upload=24261]: Upload finished. err: <nil> Aug 8 09:05:58.911609156 (23h25m58.500954143s) [upload=24270]: Starting upload Aug 8 09:05:58.911647900 (23h25m58.500992887s) [upload=24270]: Done starting upload Aug 8 09:05:58.911701302 (23h25m58.50104629s) [upload=24270]: Uploading segments... Aug 8 09:05:58.911733344 (23h25m58.501078331s) [upload=24270]: Got next segment. Inline: true Aug 8 09:05:58.911737231 (23h25m58.501082218s) [upload=24270]: Waiting for error group managing segments... Aug 8 09:05:58.911770514 (23h25m58.501115501s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:58.911774562 (23h25m58.501119549s) [upload=24270]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:58.911777338 (23h25m58.501122325s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:59.179929718 (23h25m58.769274695s) [upload=24270]: Done uploading segments... Aug 8 09:05:59.179950949 (23h25m58.769295936s) [upload=24270]: Upload finished. err: <nil> Aug 8 09:07:07.887277101 (23h27m7.476622088s) [upload=24294]: Starting upload Aug 8 09:07:07.887403684 (23h27m7.476748721s) [upload=24294]: Done starting upload Aug 8 09:07:07.887460572 (23h27m7.47680556s) [upload=24294]: Uploading segments... Aug 8 09:07:07.887493135 (23h27m7.476838122s) [upload=24294]: Got next segment. Inline: true Aug 8 09:07:07.887496842 (23h27m7.476841829s) [upload=24294]: Waiting for error group managing segments... Aug 8 09:07:07.887533232 (23h27m7.476878219s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:07:07.887537299 (23h27m7.476882287s) [upload=24294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:07:07.887541437 (23h27m7.476886424s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:07:08.159871109 (23h27m7.749216096s) [upload=24294]: Done uploading segments... Aug 8 09:07:08.159889454 (23h27m7.749234441s) [upload=24294]: Upload finished. err: <nil> Aug 8 09:08:00.823985128 (23h28m0.413330145s) [upload=24310]: Starting upload Aug 8 09:08:00.824046044 (23h28m0.413391031s) [upload=24310]: Done starting upload Aug 8 09:08:00.824106660 (23h28m0.413451647s) [upload=24310]: Uploading segments... Aug 8 09:08:00.824204177 (23h28m0.413549164s) [upload=24310]: Got next segment. Inline: true Aug 8 09:08:00.824208896 (23h28m0.413553883s) [upload=24310]: Waiting for error group managing segments... Aug 8 09:08:00.824261176 (23h28m0.413606163s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:00.824265544 (23h28m0.413610531s) [upload=24310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:00.824267758 (23h28m0.413612746s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:01.102285695 (23h28m0.691630682s) [upload=24310]: Done uploading segments... Aug 8 09:08:01.102301354 (23h28m0.691646341s) [upload=24310]: Upload finished. err: <nil> Aug 8 09:08:36.198637107 (23h28m35.787982094s) [upload=24321]: Starting upload Aug 8 09:08:36.198683246 (23h28m35.788028233s) [upload=24321]: Done starting upload Aug 8 09:08:36.198732059 (23h28m35.788077046s) [upload=24321]: Uploading segments... Aug 8 09:08:36.198762828 (23h28m35.788107815s) [upload=24321]: Got next segment. Inline: true Aug 8 09:08:36.198767036 (23h28m35.788112023s) [upload=24321]: Waiting for error group managing segments... Aug 8 09:08:36.198804087 (23h28m35.788149064s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:36.198808064 (23h28m35.788153051s) [upload=24321]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:36.198810579 (23h28m35.788155556s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:36.481859401 (23h28m36.071204378s) [upload=24321]: Done uploading segments... Aug 8 09:08:36.481876865 (23h28m36.071221852s) [upload=24321]: Upload finished. err: <nil> Aug 8 09:09:31.326588967 (23h29m30.915933954s) [upload=24333]: Starting upload Aug 8 09:09:31.326646547 (23h29m30.915991534s) [upload=24333]: Done starting upload Aug 8 09:09:31.326703516 (23h29m30.916048513s) [upload=24333]: Uploading segments... Aug 8 09:09:31.326740537 (23h29m30.916085524s) [upload=24333]: Got next segment. Inline: true Aug 8 09:09:31.326746218 (23h29m30.916091215s) [upload=24333]: Waiting for error group managing segments... Aug 8 09:09:31.326787266 (23h29m30.916132263s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:09:31.326792266 (23h29m30.916137253s) [upload=24333]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:09:31.326795482 (23h29m30.916140469s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:09:31.593342039 (23h29m31.182687026s) [upload=24333]: Done uploading segments... Aug 8 09:09:31.593361256 (23h29m31.182706243s) [upload=24333]: Upload finished. err: <nil> Aug 8 09:10:12.631543380 (23h30m12.220888367s) [upload=24346]: Starting upload Aug 8 09:10:12.631578136 (23h30m12.220923123s) [upload=24346]: Done starting upload Aug 8 09:10:12.631629504 (23h30m12.220974481s) [upload=24346]: Uploading segments... Aug 8 09:10:12.631656296 (23h30m12.221001283s) [upload=24346]: Got next segment. Inline: true Aug 8 09:10:12.631659311 (23h30m12.221004298s) [upload=24346]: Waiting for error group managing segments... Aug 8 09:10:12.631686563 (23h30m12.22103154s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.631690932 (23h30m12.221035919s) [upload=24346]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.631693126 (23h30m12.221038113s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.846075276 (23h30m12.435420263s) [upload=24346]: Done uploading segments... Aug 8 09:10:12.846094392 (23h30m12.435439379s) [upload=24346]: Upload finished. err: metaclient: Too Many Requests Duration: 1.831852098s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X..............X..X........................X....] duration: 1.843291146s FAIL (2025-08-08 09:14:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== uploading segments... Aug 8 09:02:23.367907514 (23h22m22.957252501s) [upload=24213]: Upload finished. err: <nil> Aug 8 09:03:04.849369405 (23h23m4.438714392s) [upload=24222]: Starting upload Aug 8 09:03:04.849410853 (23h23m4.43875584s) [upload=24222]: Done starting upload Aug 8 09:03:04.849453145 (23h23m4.438798132s) [upload=24222]: Uploading segments... Aug 8 09:03:04.849489875 (23h23m4.438834892s) [upload=24222]: Got next segment. Inline: true Aug 8 09:03:04.849497329 (23h23m4.438842316s) [upload=24222]: Waiting for error group managing segments... Aug 8 09:03:04.849544659 (23h23m4.438889657s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:04.849550801 (23h23m4.438895818s) [upload=24222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:04.849557974 (23h23m4.438903002s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:05.205142106 (23h23m4.794487094s) [upload=24222]: Done uploading segments... Aug 8 09:03:05.205159701 (23h23m4.794504688s) [upload=24222]: Upload finished. err: <nil> Aug 8 09:03:31.827381913 (23h23m31.41672689s) [upload=24228]: Starting upload Aug 8 09:03:31.827450525 (23h23m31.416795512s) [upload=24228]: Done starting upload Aug 8 09:03:31.827498557 (23h23m31.416843534s) [upload=24228]: Uploading segments... Aug 8 09:03:31.827530538 (23h23m31.416875525s) [upload=24228]: Got next segment. Inline: true Aug 8 09:03:31.827534195 (23h23m31.416879182s) [upload=24228]: Waiting for error group managing segments... Aug 8 09:03:31.827565324 (23h23m31.416910312s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:31.827569041 (23h23m31.416914029s) [upload=24228]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:31.827571246 (23h23m31.416916233s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:32.104386551 (23h23m31.693731538s) [upload=24228]: Done uploading segments... Aug 8 09:03:32.104408623 (23h23m31.69375361s) [upload=24228]: Upload finished. err: <nil> Aug 8 09:04:43.145652766 (23h24m42.734997753s) [upload=24247]: Starting upload Aug 8 09:04:43.145734532 (23h24m42.73507952s) [upload=24247]: Done starting upload Aug 8 09:04:43.145853431 (23h24m42.735198418s) [upload=24247]: Uploading segments... Aug 8 09:04:43.145885432 (23h24m42.735230419s) [upload=24247]: Got next segment. Inline: true Aug 8 09:04:43.145889289 (23h24m42.735234276s) [upload=24247]: Waiting for error group managing segments... Aug 8 09:04:43.145934074 (23h24m42.735279051s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:04:43.145938093 (23h24m42.73528308s) [upload=24247]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:04:43.145940287 (23h24m42.735285264s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:04:43.422274420 (23h24m43.011619407s) [upload=24247]: Done uploading segments... Aug 8 09:04:43.422293056 (23h24m43.011638043s) [upload=24247]: Upload finished. err: <nil> Aug 8 09:05:31.091183161 (23h25m30.680528148s) [upload=24261]: Starting upload Aug 8 09:05:31.091257574 (23h25m30.680602561s) [upload=24261]: Done starting upload Aug 8 09:05:31.091378225 (23h25m30.680723213s) [upload=24261]: Uploading segments... Aug 8 09:05:31.091418482 (23h25m30.680763469s) [upload=24261]: Got next segment. Inline: true Aug 8 09:05:31.091422620 (23h25m30.680767597s) [upload=24261]: Waiting for error group managing segments... Aug 8 09:05:31.091459660 (23h25m30.680804637s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:31.091463338 (23h25m30.680808325s) [upload=24261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:31.091465803 (23h25m30.68081079s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:31.369905164 (23h25m30.959250151s) [upload=24261]: Done uploading segments... Aug 8 09:05:31.369927577 (23h25m30.959272575s) [upload=24261]: Upload finished. err: <nil> Aug 8 09:05:58.911609156 (23h25m58.500954143s) [upload=24270]: Starting upload Aug 8 09:05:58.911647900 (23h25m58.500992887s) [upload=24270]: Done starting upload Aug 8 09:05:58.911701302 (23h25m58.50104629s) [upload=24270]: Uploading segments... Aug 8 09:05:58.911733344 (23h25m58.501078331s) [upload=24270]: Got next segment. Inline: true Aug 8 09:05:58.911737231 (23h25m58.501082218s) [upload=24270]: Waiting for error group managing segments... Aug 8 09:05:58.911770514 (23h25m58.501115501s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:58.911774562 (23h25m58.501119549s) [upload=24270]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:58.911777338 (23h25m58.501122325s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:59.179929718 (23h25m58.769274695s) [upload=24270]: Done uploading segments... Aug 8 09:05:59.179950949 (23h25m58.769295936s) [upload=24270]: Upload finished. err: <nil> Aug 8 09:07:07.887277101 (23h27m7.476622088s) [upload=24294]: Starting upload Aug 8 09:07:07.887403684 (23h27m7.476748721s) [upload=24294]: Done starting upload Aug 8 09:07:07.887460572 (23h27m7.47680556s) [upload=24294]: Uploading segments... Aug 8 09:07:07.887493135 (23h27m7.476838122s) [upload=24294]: Got next segment. Inline: true Aug 8 09:07:07.887496842 (23h27m7.476841829s) [upload=24294]: Waiting for error group managing segments... Aug 8 09:07:07.887533232 (23h27m7.476878219s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:07:07.887537299 (23h27m7.476882287s) [upload=24294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:07:07.887541437 (23h27m7.476886424s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:07:08.159871109 (23h27m7.749216096s) [upload=24294]: Done uploading segments... Aug 8 09:07:08.159889454 (23h27m7.749234441s) [upload=24294]: Upload finished. err: <nil> Aug 8 09:08:00.823985128 (23h28m0.413330145s) [upload=24310]: Starting upload Aug 8 09:08:00.824046044 (23h28m0.413391031s) [upload=24310]: Done starting upload Aug 8 09:08:00.824106660 (23h28m0.413451647s) [upload=24310]: Uploading segments... Aug 8 09:08:00.824204177 (23h28m0.413549164s) [upload=24310]: Got next segment. Inline: true Aug 8 09:08:00.824208896 (23h28m0.413553883s) [upload=24310]: Waiting for error group managing segments... Aug 8 09:08:00.824261176 (23h28m0.413606163s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:00.824265544 (23h28m0.413610531s) [upload=24310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:00.824267758 (23h28m0.413612746s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:01.102285695 (23h28m0.691630682s) [upload=24310]: Done uploading segments... Aug 8 09:08:01.102301354 (23h28m0.691646341s) [upload=24310]: Upload finished. err: <nil> Aug 8 09:08:36.198637107 (23h28m35.787982094s) [upload=24321]: Starting upload Aug 8 09:08:36.198683246 (23h28m35.788028233s) [upload=24321]: Done starting upload Aug 8 09:08:36.198732059 (23h28m35.788077046s) [upload=24321]: Uploading segments... Aug 8 09:08:36.198762828 (23h28m35.788107815s) [upload=24321]: Got next segment. Inline: true Aug 8 09:08:36.198767036 (23h28m35.788112023s) [upload=24321]: Waiting for error group managing segments... Aug 8 09:08:36.198804087 (23h28m35.788149064s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:36.198808064 (23h28m35.788153051s) [upload=24321]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:36.198810579 (23h28m35.788155556s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:36.481859401 (23h28m36.071204378s) [upload=24321]: Done uploading segments... Aug 8 09:08:36.481876865 (23h28m36.071221852s) [upload=24321]: Upload finished. err: <nil> Aug 8 09:09:31.326588967 (23h29m30.915933954s) [upload=24333]: Starting upload Aug 8 09:09:31.326646547 (23h29m30.915991534s) [upload=24333]: Done starting upload Aug 8 09:09:31.326703516 (23h29m30.916048513s) [upload=24333]: Uploading segments... Aug 8 09:09:31.326740537 (23h29m30.916085524s) [upload=24333]: Got next segment. Inline: true Aug 8 09:09:31.326746218 (23h29m30.916091215s) [upload=24333]: Waiting for error group managing segments... Aug 8 09:09:31.326787266 (23h29m30.916132263s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:09:31.326792266 (23h29m30.916137253s) [upload=24333]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:09:31.326795482 (23h29m30.916140469s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:09:31.593342039 (23h29m31.182687026s) [upload=24333]: Done uploading segments... Aug 8 09:09:31.593361256 (23h29m31.182706243s) [upload=24333]: Upload finished. err: <nil> Aug 8 09:10:12.631543380 (23h30m12.220888367s) [upload=24346]: Starting upload Aug 8 09:10:12.631578136 (23h30m12.220923123s) [upload=24346]: Done starting upload Aug 8 09:10:12.631629504 (23h30m12.220974481s) [upload=24346]: Uploading segments... Aug 8 09:10:12.631656296 (23h30m12.221001283s) [upload=24346]: Got next segment. Inline: true Aug 8 09:10:12.631659311 (23h30m12.221004298s) [upload=24346]: Waiting for error group managing segments... Aug 8 09:10:12.631686563 (23h30m12.22103154s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.631690932 (23h30m12.221035919s) [upload=24346]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.631693126 (23h30m12.221038113s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.846075276 (23h30m12.435420263s) [upload=24346]: Done uploading segments... Aug 8 09:10:12.846094392 (23h30m12.435439379s) [upload=24346]: Upload finished. err: metaclient: Too Many Requests Duration: 1.84331967s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X....................................X...] duration: 5.569741512s FAIL (2025-08-08 09:13:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.569767673s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............X..............X..X........................X...] duration: 1.880896405s FAIL (2025-08-08 09:13:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== uploading segments... Aug 8 09:02:23.367907514 (23h22m22.957252501s) [upload=24213]: Upload finished. err: <nil> Aug 8 09:03:04.849369405 (23h23m4.438714392s) [upload=24222]: Starting upload Aug 8 09:03:04.849410853 (23h23m4.43875584s) [upload=24222]: Done starting upload Aug 8 09:03:04.849453145 (23h23m4.438798132s) [upload=24222]: Uploading segments... Aug 8 09:03:04.849489875 (23h23m4.438834892s) [upload=24222]: Got next segment. Inline: true Aug 8 09:03:04.849497329 (23h23m4.438842316s) [upload=24222]: Waiting for error group managing segments... Aug 8 09:03:04.849544659 (23h23m4.438889657s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:04.849550801 (23h23m4.438895818s) [upload=24222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:04.849557974 (23h23m4.438903002s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:05.205142106 (23h23m4.794487094s) [upload=24222]: Done uploading segments... Aug 8 09:03:05.205159701 (23h23m4.794504688s) [upload=24222]: Upload finished. err: <nil> Aug 8 09:03:31.827381913 (23h23m31.41672689s) [upload=24228]: Starting upload Aug 8 09:03:31.827450525 (23h23m31.416795512s) [upload=24228]: Done starting upload Aug 8 09:03:31.827498557 (23h23m31.416843534s) [upload=24228]: Uploading segments... Aug 8 09:03:31.827530538 (23h23m31.416875525s) [upload=24228]: Got next segment. Inline: true Aug 8 09:03:31.827534195 (23h23m31.416879182s) [upload=24228]: Waiting for error group managing segments... Aug 8 09:03:31.827565324 (23h23m31.416910312s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:31.827569041 (23h23m31.416914029s) [upload=24228]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:31.827571246 (23h23m31.416916233s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:32.104386551 (23h23m31.693731538s) [upload=24228]: Done uploading segments... Aug 8 09:03:32.104408623 (23h23m31.69375361s) [upload=24228]: Upload finished. err: <nil> Aug 8 09:04:43.145652766 (23h24m42.734997753s) [upload=24247]: Starting upload Aug 8 09:04:43.145734532 (23h24m42.73507952s) [upload=24247]: Done starting upload Aug 8 09:04:43.145853431 (23h24m42.735198418s) [upload=24247]: Uploading segments... Aug 8 09:04:43.145885432 (23h24m42.735230419s) [upload=24247]: Got next segment. Inline: true Aug 8 09:04:43.145889289 (23h24m42.735234276s) [upload=24247]: Waiting for error group managing segments... Aug 8 09:04:43.145934074 (23h24m42.735279051s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:04:43.145938093 (23h24m42.73528308s) [upload=24247]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:04:43.145940287 (23h24m42.735285264s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:04:43.422274420 (23h24m43.011619407s) [upload=24247]: Done uploading segments... Aug 8 09:04:43.422293056 (23h24m43.011638043s) [upload=24247]: Upload finished. err: <nil> Aug 8 09:05:31.091183161 (23h25m30.680528148s) [upload=24261]: Starting upload Aug 8 09:05:31.091257574 (23h25m30.680602561s) [upload=24261]: Done starting upload Aug 8 09:05:31.091378225 (23h25m30.680723213s) [upload=24261]: Uploading segments... Aug 8 09:05:31.091418482 (23h25m30.680763469s) [upload=24261]: Got next segment. Inline: true Aug 8 09:05:31.091422620 (23h25m30.680767597s) [upload=24261]: Waiting for error group managing segments... Aug 8 09:05:31.091459660 (23h25m30.680804637s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:31.091463338 (23h25m30.680808325s) [upload=24261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:31.091465803 (23h25m30.68081079s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:31.369905164 (23h25m30.959250151s) [upload=24261]: Done uploading segments... Aug 8 09:05:31.369927577 (23h25m30.959272575s) [upload=24261]: Upload finished. err: <nil> Aug 8 09:05:58.911609156 (23h25m58.500954143s) [upload=24270]: Starting upload Aug 8 09:05:58.911647900 (23h25m58.500992887s) [upload=24270]: Done starting upload Aug 8 09:05:58.911701302 (23h25m58.50104629s) [upload=24270]: Uploading segments... Aug 8 09:05:58.911733344 (23h25m58.501078331s) [upload=24270]: Got next segment. Inline: true Aug 8 09:05:58.911737231 (23h25m58.501082218s) [upload=24270]: Waiting for error group managing segments... Aug 8 09:05:58.911770514 (23h25m58.501115501s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:58.911774562 (23h25m58.501119549s) [upload=24270]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:58.911777338 (23h25m58.501122325s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:59.179929718 (23h25m58.769274695s) [upload=24270]: Done uploading segments... Aug 8 09:05:59.179950949 (23h25m58.769295936s) [upload=24270]: Upload finished. err: <nil> Aug 8 09:07:07.887277101 (23h27m7.476622088s) [upload=24294]: Starting upload Aug 8 09:07:07.887403684 (23h27m7.476748721s) [upload=24294]: Done starting upload Aug 8 09:07:07.887460572 (23h27m7.47680556s) [upload=24294]: Uploading segments... Aug 8 09:07:07.887493135 (23h27m7.476838122s) [upload=24294]: Got next segment. Inline: true Aug 8 09:07:07.887496842 (23h27m7.476841829s) [upload=24294]: Waiting for error group managing segments... Aug 8 09:07:07.887533232 (23h27m7.476878219s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:07:07.887537299 (23h27m7.476882287s) [upload=24294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:07:07.887541437 (23h27m7.476886424s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:07:08.159871109 (23h27m7.749216096s) [upload=24294]: Done uploading segments... Aug 8 09:07:08.159889454 (23h27m7.749234441s) [upload=24294]: Upload finished. err: <nil> Aug 8 09:08:00.823985128 (23h28m0.413330145s) [upload=24310]: Starting upload Aug 8 09:08:00.824046044 (23h28m0.413391031s) [upload=24310]: Done starting upload Aug 8 09:08:00.824106660 (23h28m0.413451647s) [upload=24310]: Uploading segments... Aug 8 09:08:00.824204177 (23h28m0.413549164s) [upload=24310]: Got next segment. Inline: true Aug 8 09:08:00.824208896 (23h28m0.413553883s) [upload=24310]: Waiting for error group managing segments... Aug 8 09:08:00.824261176 (23h28m0.413606163s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:00.824265544 (23h28m0.413610531s) [upload=24310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:00.824267758 (23h28m0.413612746s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:01.102285695 (23h28m0.691630682s) [upload=24310]: Done uploading segments... Aug 8 09:08:01.102301354 (23h28m0.691646341s) [upload=24310]: Upload finished. err: <nil> Aug 8 09:08:36.198637107 (23h28m35.787982094s) [upload=24321]: Starting upload Aug 8 09:08:36.198683246 (23h28m35.788028233s) [upload=24321]: Done starting upload Aug 8 09:08:36.198732059 (23h28m35.788077046s) [upload=24321]: Uploading segments... Aug 8 09:08:36.198762828 (23h28m35.788107815s) [upload=24321]: Got next segment. Inline: true Aug 8 09:08:36.198767036 (23h28m35.788112023s) [upload=24321]: Waiting for error group managing segments... Aug 8 09:08:36.198804087 (23h28m35.788149064s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:36.198808064 (23h28m35.788153051s) [upload=24321]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:36.198810579 (23h28m35.788155556s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:36.481859401 (23h28m36.071204378s) [upload=24321]: Done uploading segments... Aug 8 09:08:36.481876865 (23h28m36.071221852s) [upload=24321]: Upload finished. err: <nil> Aug 8 09:09:31.326588967 (23h29m30.915933954s) [upload=24333]: Starting upload Aug 8 09:09:31.326646547 (23h29m30.915991534s) [upload=24333]: Done starting upload Aug 8 09:09:31.326703516 (23h29m30.916048513s) [upload=24333]: Uploading segments... Aug 8 09:09:31.326740537 (23h29m30.916085524s) [upload=24333]: Got next segment. Inline: true Aug 8 09:09:31.326746218 (23h29m30.916091215s) [upload=24333]: Waiting for error group managing segments... Aug 8 09:09:31.326787266 (23h29m30.916132263s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:09:31.326792266 (23h29m30.916137253s) [upload=24333]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:09:31.326795482 (23h29m30.916140469s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:09:31.593342039 (23h29m31.182687026s) [upload=24333]: Done uploading segments... Aug 8 09:09:31.593361256 (23h29m31.182706243s) [upload=24333]: Upload finished. err: <nil> Aug 8 09:10:12.631543380 (23h30m12.220888367s) [upload=24346]: Starting upload Aug 8 09:10:12.631578136 (23h30m12.220923123s) [upload=24346]: Done starting upload Aug 8 09:10:12.631629504 (23h30m12.220974481s) [upload=24346]: Uploading segments... Aug 8 09:10:12.631656296 (23h30m12.221001283s) [upload=24346]: Got next segment. Inline: true Aug 8 09:10:12.631659311 (23h30m12.221004298s) [upload=24346]: Waiting for error group managing segments... Aug 8 09:10:12.631686563 (23h30m12.22103154s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.631690932 (23h30m12.221035919s) [upload=24346]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.631693126 (23h30m12.221038113s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.846075276 (23h30m12.435420263s) [upload=24346]: Done uploading segments... Aug 8 09:10:12.846094392 (23h30m12.435439379s) [upload=24346]: Upload finished. err: metaclient: Too Many Requests Duration: 1.880924198s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X....................................X..] duration: 5.599533007s FAIL (2025-08-08 09:12:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.599557102s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X..............X..X........................X..] duration: 1.876835918s FAIL (2025-08-08 09:12:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== uploading segments... Aug 8 09:02:23.367907514 (23h22m22.957252501s) [upload=24213]: Upload finished. err: <nil> Aug 8 09:03:04.849369405 (23h23m4.438714392s) [upload=24222]: Starting upload Aug 8 09:03:04.849410853 (23h23m4.43875584s) [upload=24222]: Done starting upload Aug 8 09:03:04.849453145 (23h23m4.438798132s) [upload=24222]: Uploading segments... Aug 8 09:03:04.849489875 (23h23m4.438834892s) [upload=24222]: Got next segment. Inline: true Aug 8 09:03:04.849497329 (23h23m4.438842316s) [upload=24222]: Waiting for error group managing segments... Aug 8 09:03:04.849544659 (23h23m4.438889657s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:04.849550801 (23h23m4.438895818s) [upload=24222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:04.849557974 (23h23m4.438903002s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:05.205142106 (23h23m4.794487094s) [upload=24222]: Done uploading segments... Aug 8 09:03:05.205159701 (23h23m4.794504688s) [upload=24222]: Upload finished. err: <nil> Aug 8 09:03:31.827381913 (23h23m31.41672689s) [upload=24228]: Starting upload Aug 8 09:03:31.827450525 (23h23m31.416795512s) [upload=24228]: Done starting upload Aug 8 09:03:31.827498557 (23h23m31.416843534s) [upload=24228]: Uploading segments... Aug 8 09:03:31.827530538 (23h23m31.416875525s) [upload=24228]: Got next segment. Inline: true Aug 8 09:03:31.827534195 (23h23m31.416879182s) [upload=24228]: Waiting for error group managing segments... Aug 8 09:03:31.827565324 (23h23m31.416910312s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:31.827569041 (23h23m31.416914029s) [upload=24228]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:31.827571246 (23h23m31.416916233s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:32.104386551 (23h23m31.693731538s) [upload=24228]: Done uploading segments... Aug 8 09:03:32.104408623 (23h23m31.69375361s) [upload=24228]: Upload finished. err: <nil> Aug 8 09:04:43.145652766 (23h24m42.734997753s) [upload=24247]: Starting upload Aug 8 09:04:43.145734532 (23h24m42.73507952s) [upload=24247]: Done starting upload Aug 8 09:04:43.145853431 (23h24m42.735198418s) [upload=24247]: Uploading segments... Aug 8 09:04:43.145885432 (23h24m42.735230419s) [upload=24247]: Got next segment. Inline: true Aug 8 09:04:43.145889289 (23h24m42.735234276s) [upload=24247]: Waiting for error group managing segments... Aug 8 09:04:43.145934074 (23h24m42.735279051s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:04:43.145938093 (23h24m42.73528308s) [upload=24247]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:04:43.145940287 (23h24m42.735285264s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:04:43.422274420 (23h24m43.011619407s) [upload=24247]: Done uploading segments... Aug 8 09:04:43.422293056 (23h24m43.011638043s) [upload=24247]: Upload finished. err: <nil> Aug 8 09:05:31.091183161 (23h25m30.680528148s) [upload=24261]: Starting upload Aug 8 09:05:31.091257574 (23h25m30.680602561s) [upload=24261]: Done starting upload Aug 8 09:05:31.091378225 (23h25m30.680723213s) [upload=24261]: Uploading segments... Aug 8 09:05:31.091418482 (23h25m30.680763469s) [upload=24261]: Got next segment. Inline: true Aug 8 09:05:31.091422620 (23h25m30.680767597s) [upload=24261]: Waiting for error group managing segments... Aug 8 09:05:31.091459660 (23h25m30.680804637s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:31.091463338 (23h25m30.680808325s) [upload=24261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:31.091465803 (23h25m30.68081079s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:31.369905164 (23h25m30.959250151s) [upload=24261]: Done uploading segments... Aug 8 09:05:31.369927577 (23h25m30.959272575s) [upload=24261]: Upload finished. err: <nil> Aug 8 09:05:58.911609156 (23h25m58.500954143s) [upload=24270]: Starting upload Aug 8 09:05:58.911647900 (23h25m58.500992887s) [upload=24270]: Done starting upload Aug 8 09:05:58.911701302 (23h25m58.50104629s) [upload=24270]: Uploading segments... Aug 8 09:05:58.911733344 (23h25m58.501078331s) [upload=24270]: Got next segment. Inline: true Aug 8 09:05:58.911737231 (23h25m58.501082218s) [upload=24270]: Waiting for error group managing segments... Aug 8 09:05:58.911770514 (23h25m58.501115501s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:58.911774562 (23h25m58.501119549s) [upload=24270]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:58.911777338 (23h25m58.501122325s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:59.179929718 (23h25m58.769274695s) [upload=24270]: Done uploading segments... Aug 8 09:05:59.179950949 (23h25m58.769295936s) [upload=24270]: Upload finished. err: <nil> Aug 8 09:07:07.887277101 (23h27m7.476622088s) [upload=24294]: Starting upload Aug 8 09:07:07.887403684 (23h27m7.476748721s) [upload=24294]: Done starting upload Aug 8 09:07:07.887460572 (23h27m7.47680556s) [upload=24294]: Uploading segments... Aug 8 09:07:07.887493135 (23h27m7.476838122s) [upload=24294]: Got next segment. Inline: true Aug 8 09:07:07.887496842 (23h27m7.476841829s) [upload=24294]: Waiting for error group managing segments... Aug 8 09:07:07.887533232 (23h27m7.476878219s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:07:07.887537299 (23h27m7.476882287s) [upload=24294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:07:07.887541437 (23h27m7.476886424s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:07:08.159871109 (23h27m7.749216096s) [upload=24294]: Done uploading segments... Aug 8 09:07:08.159889454 (23h27m7.749234441s) [upload=24294]: Upload finished. err: <nil> Aug 8 09:08:00.823985128 (23h28m0.413330145s) [upload=24310]: Starting upload Aug 8 09:08:00.824046044 (23h28m0.413391031s) [upload=24310]: Done starting upload Aug 8 09:08:00.824106660 (23h28m0.413451647s) [upload=24310]: Uploading segments... Aug 8 09:08:00.824204177 (23h28m0.413549164s) [upload=24310]: Got next segment. Inline: true Aug 8 09:08:00.824208896 (23h28m0.413553883s) [upload=24310]: Waiting for error group managing segments... Aug 8 09:08:00.824261176 (23h28m0.413606163s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:00.824265544 (23h28m0.413610531s) [upload=24310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:00.824267758 (23h28m0.413612746s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:01.102285695 (23h28m0.691630682s) [upload=24310]: Done uploading segments... Aug 8 09:08:01.102301354 (23h28m0.691646341s) [upload=24310]: Upload finished. err: <nil> Aug 8 09:08:36.198637107 (23h28m35.787982094s) [upload=24321]: Starting upload Aug 8 09:08:36.198683246 (23h28m35.788028233s) [upload=24321]: Done starting upload Aug 8 09:08:36.198732059 (23h28m35.788077046s) [upload=24321]: Uploading segments... Aug 8 09:08:36.198762828 (23h28m35.788107815s) [upload=24321]: Got next segment. Inline: true Aug 8 09:08:36.198767036 (23h28m35.788112023s) [upload=24321]: Waiting for error group managing segments... Aug 8 09:08:36.198804087 (23h28m35.788149064s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:36.198808064 (23h28m35.788153051s) [upload=24321]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:36.198810579 (23h28m35.788155556s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:36.481859401 (23h28m36.071204378s) [upload=24321]: Done uploading segments... Aug 8 09:08:36.481876865 (23h28m36.071221852s) [upload=24321]: Upload finished. err: <nil> Aug 8 09:09:31.326588967 (23h29m30.915933954s) [upload=24333]: Starting upload Aug 8 09:09:31.326646547 (23h29m30.915991534s) [upload=24333]: Done starting upload Aug 8 09:09:31.326703516 (23h29m30.916048513s) [upload=24333]: Uploading segments... Aug 8 09:09:31.326740537 (23h29m30.916085524s) [upload=24333]: Got next segment. Inline: true Aug 8 09:09:31.326746218 (23h29m30.916091215s) [upload=24333]: Waiting for error group managing segments... Aug 8 09:09:31.326787266 (23h29m30.916132263s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:09:31.326792266 (23h29m30.916137253s) [upload=24333]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:09:31.326795482 (23h29m30.916140469s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:09:31.593342039 (23h29m31.182687026s) [upload=24333]: Done uploading segments... Aug 8 09:09:31.593361256 (23h29m31.182706243s) [upload=24333]: Upload finished. err: <nil> Aug 8 09:10:12.631543380 (23h30m12.220888367s) [upload=24346]: Starting upload Aug 8 09:10:12.631578136 (23h30m12.220923123s) [upload=24346]: Done starting upload Aug 8 09:10:12.631629504 (23h30m12.220974481s) [upload=24346]: Uploading segments... Aug 8 09:10:12.631656296 (23h30m12.221001283s) [upload=24346]: Got next segment. Inline: true Aug 8 09:10:12.631659311 (23h30m12.221004298s) [upload=24346]: Waiting for error group managing segments... Aug 8 09:10:12.631686563 (23h30m12.22103154s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.631690932 (23h30m12.221035919s) [upload=24346]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.631693126 (23h30m12.221038113s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.846075276 (23h30m12.435420263s) [upload=24346]: Done uploading segments... Aug 8 09:10:12.846094392 (23h30m12.435439379s) [upload=24346]: Upload finished. err: metaclient: Too Many Requests Duration: 1.876859684s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X....................X....................................X.] duration: 5.638230788s FAIL (2025-08-08 09:11:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.638250645s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............X..............X..X........................X.] duration: 1.900222973s FAIL (2025-08-08 09:11:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== uploading segments... Aug 8 09:02:23.367907514 (23h22m22.957252501s) [upload=24213]: Upload finished. err: <nil> Aug 8 09:03:04.849369405 (23h23m4.438714392s) [upload=24222]: Starting upload Aug 8 09:03:04.849410853 (23h23m4.43875584s) [upload=24222]: Done starting upload Aug 8 09:03:04.849453145 (23h23m4.438798132s) [upload=24222]: Uploading segments... Aug 8 09:03:04.849489875 (23h23m4.438834892s) [upload=24222]: Got next segment. Inline: true Aug 8 09:03:04.849497329 (23h23m4.438842316s) [upload=24222]: Waiting for error group managing segments... Aug 8 09:03:04.849544659 (23h23m4.438889657s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:04.849550801 (23h23m4.438895818s) [upload=24222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:04.849557974 (23h23m4.438903002s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:05.205142106 (23h23m4.794487094s) [upload=24222]: Done uploading segments... Aug 8 09:03:05.205159701 (23h23m4.794504688s) [upload=24222]: Upload finished. err: <nil> Aug 8 09:03:31.827381913 (23h23m31.41672689s) [upload=24228]: Starting upload Aug 8 09:03:31.827450525 (23h23m31.416795512s) [upload=24228]: Done starting upload Aug 8 09:03:31.827498557 (23h23m31.416843534s) [upload=24228]: Uploading segments... Aug 8 09:03:31.827530538 (23h23m31.416875525s) [upload=24228]: Got next segment. Inline: true Aug 8 09:03:31.827534195 (23h23m31.416879182s) [upload=24228]: Waiting for error group managing segments... Aug 8 09:03:31.827565324 (23h23m31.416910312s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:31.827569041 (23h23m31.416914029s) [upload=24228]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:31.827571246 (23h23m31.416916233s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:32.104386551 (23h23m31.693731538s) [upload=24228]: Done uploading segments... Aug 8 09:03:32.104408623 (23h23m31.69375361s) [upload=24228]: Upload finished. err: <nil> Aug 8 09:04:43.145652766 (23h24m42.734997753s) [upload=24247]: Starting upload Aug 8 09:04:43.145734532 (23h24m42.73507952s) [upload=24247]: Done starting upload Aug 8 09:04:43.145853431 (23h24m42.735198418s) [upload=24247]: Uploading segments... Aug 8 09:04:43.145885432 (23h24m42.735230419s) [upload=24247]: Got next segment. Inline: true Aug 8 09:04:43.145889289 (23h24m42.735234276s) [upload=24247]: Waiting for error group managing segments... Aug 8 09:04:43.145934074 (23h24m42.735279051s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:04:43.145938093 (23h24m42.73528308s) [upload=24247]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:04:43.145940287 (23h24m42.735285264s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:04:43.422274420 (23h24m43.011619407s) [upload=24247]: Done uploading segments... Aug 8 09:04:43.422293056 (23h24m43.011638043s) [upload=24247]: Upload finished. err: <nil> Aug 8 09:05:31.091183161 (23h25m30.680528148s) [upload=24261]: Starting upload Aug 8 09:05:31.091257574 (23h25m30.680602561s) [upload=24261]: Done starting upload Aug 8 09:05:31.091378225 (23h25m30.680723213s) [upload=24261]: Uploading segments... Aug 8 09:05:31.091418482 (23h25m30.680763469s) [upload=24261]: Got next segment. Inline: true Aug 8 09:05:31.091422620 (23h25m30.680767597s) [upload=24261]: Waiting for error group managing segments... Aug 8 09:05:31.091459660 (23h25m30.680804637s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:31.091463338 (23h25m30.680808325s) [upload=24261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:31.091465803 (23h25m30.68081079s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:31.369905164 (23h25m30.959250151s) [upload=24261]: Done uploading segments... Aug 8 09:05:31.369927577 (23h25m30.959272575s) [upload=24261]: Upload finished. err: <nil> Aug 8 09:05:58.911609156 (23h25m58.500954143s) [upload=24270]: Starting upload Aug 8 09:05:58.911647900 (23h25m58.500992887s) [upload=24270]: Done starting upload Aug 8 09:05:58.911701302 (23h25m58.50104629s) [upload=24270]: Uploading segments... Aug 8 09:05:58.911733344 (23h25m58.501078331s) [upload=24270]: Got next segment. Inline: true Aug 8 09:05:58.911737231 (23h25m58.501082218s) [upload=24270]: Waiting for error group managing segments... Aug 8 09:05:58.911770514 (23h25m58.501115501s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:58.911774562 (23h25m58.501119549s) [upload=24270]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:58.911777338 (23h25m58.501122325s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:59.179929718 (23h25m58.769274695s) [upload=24270]: Done uploading segments... Aug 8 09:05:59.179950949 (23h25m58.769295936s) [upload=24270]: Upload finished. err: <nil> Aug 8 09:07:07.887277101 (23h27m7.476622088s) [upload=24294]: Starting upload Aug 8 09:07:07.887403684 (23h27m7.476748721s) [upload=24294]: Done starting upload Aug 8 09:07:07.887460572 (23h27m7.47680556s) [upload=24294]: Uploading segments... Aug 8 09:07:07.887493135 (23h27m7.476838122s) [upload=24294]: Got next segment. Inline: true Aug 8 09:07:07.887496842 (23h27m7.476841829s) [upload=24294]: Waiting for error group managing segments... Aug 8 09:07:07.887533232 (23h27m7.476878219s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:07:07.887537299 (23h27m7.476882287s) [upload=24294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:07:07.887541437 (23h27m7.476886424s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:07:08.159871109 (23h27m7.749216096s) [upload=24294]: Done uploading segments... Aug 8 09:07:08.159889454 (23h27m7.749234441s) [upload=24294]: Upload finished. err: <nil> Aug 8 09:08:00.823985128 (23h28m0.413330145s) [upload=24310]: Starting upload Aug 8 09:08:00.824046044 (23h28m0.413391031s) [upload=24310]: Done starting upload Aug 8 09:08:00.824106660 (23h28m0.413451647s) [upload=24310]: Uploading segments... Aug 8 09:08:00.824204177 (23h28m0.413549164s) [upload=24310]: Got next segment. Inline: true Aug 8 09:08:00.824208896 (23h28m0.413553883s) [upload=24310]: Waiting for error group managing segments... Aug 8 09:08:00.824261176 (23h28m0.413606163s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:00.824265544 (23h28m0.413610531s) [upload=24310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:00.824267758 (23h28m0.413612746s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:01.102285695 (23h28m0.691630682s) [upload=24310]: Done uploading segments... Aug 8 09:08:01.102301354 (23h28m0.691646341s) [upload=24310]: Upload finished. err: <nil> Aug 8 09:08:36.198637107 (23h28m35.787982094s) [upload=24321]: Starting upload Aug 8 09:08:36.198683246 (23h28m35.788028233s) [upload=24321]: Done starting upload Aug 8 09:08:36.198732059 (23h28m35.788077046s) [upload=24321]: Uploading segments... Aug 8 09:08:36.198762828 (23h28m35.788107815s) [upload=24321]: Got next segment. Inline: true Aug 8 09:08:36.198767036 (23h28m35.788112023s) [upload=24321]: Waiting for error group managing segments... Aug 8 09:08:36.198804087 (23h28m35.788149064s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:36.198808064 (23h28m35.788153051s) [upload=24321]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:36.198810579 (23h28m35.788155556s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:36.481859401 (23h28m36.071204378s) [upload=24321]: Done uploading segments... Aug 8 09:08:36.481876865 (23h28m36.071221852s) [upload=24321]: Upload finished. err: <nil> Aug 8 09:09:31.326588967 (23h29m30.915933954s) [upload=24333]: Starting upload Aug 8 09:09:31.326646547 (23h29m30.915991534s) [upload=24333]: Done starting upload Aug 8 09:09:31.326703516 (23h29m30.916048513s) [upload=24333]: Uploading segments... Aug 8 09:09:31.326740537 (23h29m30.916085524s) [upload=24333]: Got next segment. Inline: true Aug 8 09:09:31.326746218 (23h29m30.916091215s) [upload=24333]: Waiting for error group managing segments... Aug 8 09:09:31.326787266 (23h29m30.916132263s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:09:31.326792266 (23h29m30.916137253s) [upload=24333]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:09:31.326795482 (23h29m30.916140469s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:09:31.593342039 (23h29m31.182687026s) [upload=24333]: Done uploading segments... Aug 8 09:09:31.593361256 (23h29m31.182706243s) [upload=24333]: Upload finished. err: <nil> Aug 8 09:10:12.631543380 (23h30m12.220888367s) [upload=24346]: Starting upload Aug 8 09:10:12.631578136 (23h30m12.220923123s) [upload=24346]: Done starting upload Aug 8 09:10:12.631629504 (23h30m12.220974481s) [upload=24346]: Uploading segments... Aug 8 09:10:12.631656296 (23h30m12.221001283s) [upload=24346]: Got next segment. Inline: true Aug 8 09:10:12.631659311 (23h30m12.221004298s) [upload=24346]: Waiting for error group managing segments... Aug 8 09:10:12.631686563 (23h30m12.22103154s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.631690932 (23h30m12.221035919s) [upload=24346]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.631693126 (23h30m12.221038113s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.846075276 (23h30m12.435420263s) [upload=24346]: Done uploading segments... Aug 8 09:10:12.846094392 (23h30m12.435439379s) [upload=24346]: Upload finished. err: metaclient: Too Many Requests Duration: 1.900257269s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X....................X....................................X] duration: 5.480843408s FAIL (2025-08-08 09:10:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after bb5adda846129328f406372bfe1d40a3f1bff9f1ef3a6e2c2d7530678015efaf != before 10c6e7b1d23f89ce2d0cc9c3bd04e56ddcf47b10d0f7e2a6c718b84c5b2700e2 ======LOGS====== Upload finished. err: <nil> Aug 8 09:10:39.419989382 (23h30m39.009334369s) [upload=24356]: Starting upload Aug 8 09:10:39.420028196 (23h30m39.009373183s) [upload=24356]: Done starting upload Aug 8 09:10:39.420249139 (23h30m39.009594126s) [upload=24356]: Uploading segments... Aug 8 09:10:39.420368027 (23h30m39.009713014s) [upload=24356]: Got next segment. Inline: false Aug 8 09:10:39.420421630 (23h30m39.009766617s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:39.420425978 (23h30m39.009770965s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 09:10:39.873646210 (23h30m39.462991187s) [seg_pos={0 0}, upload=24356]: Begin upload segment... Aug 8 09:10:39.873696236 (23h30m39.463041223s) [seg_pos={0 0}, upload=24356]: Done begin upload segment. Aug 8 09:10:39.873717437 (23h30m39.463062424s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.873817257 (23h30m39.463162244s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874126069 (23h30m39.463471056s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874310841 (23h30m39.463655818s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874424259 (23h30m39.463769246s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874699175 (23h30m39.464044162s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.874783116 (23h30m39.464128103s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875047201 (23h30m39.464392178s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875090313 (23h30m39.46443529s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875421938 (23h30m39.464766915s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875442267 (23h30m39.464787254s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875724186 (23h30m39.465069173s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.875797947 (23h30m39.465142934s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876000064 (23h30m39.465345051s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876077883 (23h30m39.46542287s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876279799 (23h30m39.465624786s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876349954 (23h30m39.465694941s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:39.876544406 (23h30m39.465889383s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Uploading piece... Aug 8 09:10:41.040685492 (23h30m40.63003048s) [upload=24356]: Next returned nil segment Aug 8 09:10:41.040701574 (23h30m40.630046561s) [upload=24356]: Waiting for error group managing segments... Aug 8 09:10:41.336616051 (23h30m40.925961048s) [noise=true , address=64.49.13.26:4951 , piece_id=JYTNMOPYKFST3IMGBFGK3OFMDSCS4W5TS26AVZ4LHTI5MJU7UUHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.778378411 (23h30m41.367723398s) [noise=true , address=104.36.82.58:4286 , piece_id=QI7TPPPRFXWY7A35CUH55PA7F42TSQY7KYP7K6YYJVV2W5ZE3BKQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.779751148 (23h30m41.369096135s) [noise=true , address=104.36.82.18:4393 , piece_id=CG25NJPOVFKP3JJAGYMGPQYFE2GFSJ772ARR33XDJJIEM7OAQN2A, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.783042586 (23h30m41.372387573s) [noise=true , address=104.36.82.45:4910 , piece_id=HTGHRLB6ZLLOYQAZTU3FEYUL3QUJVYTJ4QZJAIRS2ARJM2XYNP4Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.799178789 (23h30m41.388523766s) [noise=true , address=104.36.82.5:4858 , piece_id=AD2VECNZ7O7L4Y44HVR62S4MACDL4VTNZPNQ5G6V2FULXULC73KA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.802077014 (23h30m41.391422001s) [noise=true , address=104.36.82.62:4435 , piece_id=4Z72EBTVGKL6TA6JZV3MI4RD5ANA2T7Z5T4ZNHXGNTBVYEPILOYQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845169965 (23h30m41.434514942s) [noise=true , address=45.91.116.14:4207 , piece_id=SMGU73IFCZM6UA5J2W6EPOIGVA3FP2FX44XB7R5H3CFDN7RDA3TQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.845309031 (23h30m41.434654018s) [noise=true , address=104.36.82.14:4234 , piece_id=Z3QBPSW7PCKWMTTW2FG2O6DGOVBGYJCZHZNY6BWHEATMVRYM7VRQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.854839886 (23h30m41.444184873s) [noise=true , address=104.36.82.60:4361 , piece_id=QDFK4EDW5EQD4LAWXDDRF3XKHDWNT5TDXCL3RIE2642LTMTQEXKA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862582140 (23h30m41.451927117s) [noise=true , address=104.36.82.23:4458 , piece_id=XLEGDVG5JA7RHFLX5YI4IWA466BE3T6YG5C4ASPGRMKKMD5ZPVAA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.862761242 (23h30m41.452106249s) [noise=true , address=104.36.82.35:4584 , piece_id=JZQ7NHU4TRJFEG5NHXH5EYDHCBC6CFQVCDYKBN5C7X2BXDZS6SZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.873314905 (23h30m41.462659892s) [noise=true , address=104.36.82.54:4177 , piece_id=5O5T466Q2Q3RMNCNAJMWCTOXFX3DLHBE4FL7RIKRVXPS2ZN2OXHA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.874354514 (23h30m41.463699501s) [noise=true , address=104.36.82.36:4648 , piece_id=UXQM47D77KAWH2GRPM7QXHIF3WMBCWEXS3RO7NKIO7XMCGMNKACQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880012590 (23h30m41.469357567s) [noise=true , address=104.36.82.37:4686 , piece_id=3BQKIZH3V2FSPLCYWHPESICSJ5CVUC36DQW2UEIR6RULPSBWSVXQ, seg_pos={0 0}, upload=24356]: Done uploading piece. err: <nil> Aug 8 09:10:41.880031345 (23h30m41.469376332s) [seg_pos={0 0}, upload=24356]: Segment reached optimal threshold of 14 pieces. Aug 8 09:10:41.880135795 (23h30m41.469480782s) [noise=true , address=104.36.82.46:4486 , piece_id=6LE2AACVUHXC35S2AYGNMNCX47QSOD2HW7QJZTAAFX7ZSRSK55ZA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbs2btcbiu2yYGrvxNZe8sNSqDnNPG1Bmfyhcew86FCFLKAic): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880168037 (23h30m41.469513024s) [noise=true , address=104.36.82.16:4308 , piece_id=BCX23ZTHNYYPVMSL7I7DBV6KHFZP347E56H7XT7QLQHFBUNVPA3Q, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PgA5SZkBvK673LsV7p2sXpbi1r79esNNZspPZTzaitqfbjtyY): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880204767 (23h30m41.469549775s) [noise=true , address=104.36.82.44:4881 , piece_id=LJKAFHVDS7KRT22KVMWHPOBXCD2DSEMOYC7YL5YTAJDG7LJUGLEA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880273949 (23h30m41.469618936s) [noise=true , address=104.36.82.43:4837 , piece_id=5CXNVMVH4EDFDZ3HJTIDC7CJE5P4CZGNFUXQTUASVXJ2RTK5TPNA, seg_pos={0 0}, upload=24356]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jmioLYNGZjDcByx8B1oHbqfid2DRqRfgoHhz85VcoTqbWz6Ls): protocol: expected piece hash; context canceled; EOF Aug 8 09:10:41.880296853 (23h30m41.46964184s) [seg_pos={0 0}, upload=24356]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 09:10:41.880407655 (23h30m41.469752652s) [upload=24356]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 09:10:41.880415009 (23h30m41.469760006s) [upload=24356]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:42.177615147 (23h30m41.766960134s) [upload=24356]: Done uploading segments... Aug 8 09:10:42.177628343 (23h30m41.76697333s) [upload=24356]: Upload finished. err: <nil> Duration: 5.480862185s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [................X..............X..X........................X] duration: 876.920804ms FAIL (2025-08-08 09:10:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== uploading segments... Aug 8 09:02:23.367907514 (23h22m22.957252501s) [upload=24213]: Upload finished. err: <nil> Aug 8 09:03:04.849369405 (23h23m4.438714392s) [upload=24222]: Starting upload Aug 8 09:03:04.849410853 (23h23m4.43875584s) [upload=24222]: Done starting upload Aug 8 09:03:04.849453145 (23h23m4.438798132s) [upload=24222]: Uploading segments... Aug 8 09:03:04.849489875 (23h23m4.438834892s) [upload=24222]: Got next segment. Inline: true Aug 8 09:03:04.849497329 (23h23m4.438842316s) [upload=24222]: Waiting for error group managing segments... Aug 8 09:03:04.849544659 (23h23m4.438889657s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:04.849550801 (23h23m4.438895818s) [upload=24222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:04.849557974 (23h23m4.438903002s) [upload=24222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:05.205142106 (23h23m4.794487094s) [upload=24222]: Done uploading segments... Aug 8 09:03:05.205159701 (23h23m4.794504688s) [upload=24222]: Upload finished. err: <nil> Aug 8 09:03:31.827381913 (23h23m31.41672689s) [upload=24228]: Starting upload Aug 8 09:03:31.827450525 (23h23m31.416795512s) [upload=24228]: Done starting upload Aug 8 09:03:31.827498557 (23h23m31.416843534s) [upload=24228]: Uploading segments... Aug 8 09:03:31.827530538 (23h23m31.416875525s) [upload=24228]: Got next segment. Inline: true Aug 8 09:03:31.827534195 (23h23m31.416879182s) [upload=24228]: Waiting for error group managing segments... Aug 8 09:03:31.827565324 (23h23m31.416910312s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:03:31.827569041 (23h23m31.416914029s) [upload=24228]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:03:31.827571246 (23h23m31.416916233s) [upload=24228]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:03:32.104386551 (23h23m31.693731538s) [upload=24228]: Done uploading segments... Aug 8 09:03:32.104408623 (23h23m31.69375361s) [upload=24228]: Upload finished. err: <nil> Aug 8 09:04:43.145652766 (23h24m42.734997753s) [upload=24247]: Starting upload Aug 8 09:04:43.145734532 (23h24m42.73507952s) [upload=24247]: Done starting upload Aug 8 09:04:43.145853431 (23h24m42.735198418s) [upload=24247]: Uploading segments... Aug 8 09:04:43.145885432 (23h24m42.735230419s) [upload=24247]: Got next segment. Inline: true Aug 8 09:04:43.145889289 (23h24m42.735234276s) [upload=24247]: Waiting for error group managing segments... Aug 8 09:04:43.145934074 (23h24m42.735279051s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:04:43.145938093 (23h24m42.73528308s) [upload=24247]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:04:43.145940287 (23h24m42.735285264s) [upload=24247]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:04:43.422274420 (23h24m43.011619407s) [upload=24247]: Done uploading segments... Aug 8 09:04:43.422293056 (23h24m43.011638043s) [upload=24247]: Upload finished. err: <nil> Aug 8 09:05:31.091183161 (23h25m30.680528148s) [upload=24261]: Starting upload Aug 8 09:05:31.091257574 (23h25m30.680602561s) [upload=24261]: Done starting upload Aug 8 09:05:31.091378225 (23h25m30.680723213s) [upload=24261]: Uploading segments... Aug 8 09:05:31.091418482 (23h25m30.680763469s) [upload=24261]: Got next segment. Inline: true Aug 8 09:05:31.091422620 (23h25m30.680767597s) [upload=24261]: Waiting for error group managing segments... Aug 8 09:05:31.091459660 (23h25m30.680804637s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:31.091463338 (23h25m30.680808325s) [upload=24261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:31.091465803 (23h25m30.68081079s) [upload=24261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:31.369905164 (23h25m30.959250151s) [upload=24261]: Done uploading segments... Aug 8 09:05:31.369927577 (23h25m30.959272575s) [upload=24261]: Upload finished. err: <nil> Aug 8 09:05:58.911609156 (23h25m58.500954143s) [upload=24270]: Starting upload Aug 8 09:05:58.911647900 (23h25m58.500992887s) [upload=24270]: Done starting upload Aug 8 09:05:58.911701302 (23h25m58.50104629s) [upload=24270]: Uploading segments... Aug 8 09:05:58.911733344 (23h25m58.501078331s) [upload=24270]: Got next segment. Inline: true Aug 8 09:05:58.911737231 (23h25m58.501082218s) [upload=24270]: Waiting for error group managing segments... Aug 8 09:05:58.911770514 (23h25m58.501115501s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:05:58.911774562 (23h25m58.501119549s) [upload=24270]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:05:58.911777338 (23h25m58.501122325s) [upload=24270]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:05:59.179929718 (23h25m58.769274695s) [upload=24270]: Done uploading segments... Aug 8 09:05:59.179950949 (23h25m58.769295936s) [upload=24270]: Upload finished. err: <nil> Aug 8 09:07:07.887277101 (23h27m7.476622088s) [upload=24294]: Starting upload Aug 8 09:07:07.887403684 (23h27m7.476748721s) [upload=24294]: Done starting upload Aug 8 09:07:07.887460572 (23h27m7.47680556s) [upload=24294]: Uploading segments... Aug 8 09:07:07.887493135 (23h27m7.476838122s) [upload=24294]: Got next segment. Inline: true Aug 8 09:07:07.887496842 (23h27m7.476841829s) [upload=24294]: Waiting for error group managing segments... Aug 8 09:07:07.887533232 (23h27m7.476878219s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:07:07.887537299 (23h27m7.476882287s) [upload=24294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:07:07.887541437 (23h27m7.476886424s) [upload=24294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:07:08.159871109 (23h27m7.749216096s) [upload=24294]: Done uploading segments... Aug 8 09:07:08.159889454 (23h27m7.749234441s) [upload=24294]: Upload finished. err: <nil> Aug 8 09:08:00.823985128 (23h28m0.413330145s) [upload=24310]: Starting upload Aug 8 09:08:00.824046044 (23h28m0.413391031s) [upload=24310]: Done starting upload Aug 8 09:08:00.824106660 (23h28m0.413451647s) [upload=24310]: Uploading segments... Aug 8 09:08:00.824204177 (23h28m0.413549164s) [upload=24310]: Got next segment. Inline: true Aug 8 09:08:00.824208896 (23h28m0.413553883s) [upload=24310]: Waiting for error group managing segments... Aug 8 09:08:00.824261176 (23h28m0.413606163s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:00.824265544 (23h28m0.413610531s) [upload=24310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:00.824267758 (23h28m0.413612746s) [upload=24310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:01.102285695 (23h28m0.691630682s) [upload=24310]: Done uploading segments... Aug 8 09:08:01.102301354 (23h28m0.691646341s) [upload=24310]: Upload finished. err: <nil> Aug 8 09:08:36.198637107 (23h28m35.787982094s) [upload=24321]: Starting upload Aug 8 09:08:36.198683246 (23h28m35.788028233s) [upload=24321]: Done starting upload Aug 8 09:08:36.198732059 (23h28m35.788077046s) [upload=24321]: Uploading segments... Aug 8 09:08:36.198762828 (23h28m35.788107815s) [upload=24321]: Got next segment. Inline: true Aug 8 09:08:36.198767036 (23h28m35.788112023s) [upload=24321]: Waiting for error group managing segments... Aug 8 09:08:36.198804087 (23h28m35.788149064s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:08:36.198808064 (23h28m35.788153051s) [upload=24321]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:08:36.198810579 (23h28m35.788155556s) [upload=24321]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:08:36.481859401 (23h28m36.071204378s) [upload=24321]: Done uploading segments... Aug 8 09:08:36.481876865 (23h28m36.071221852s) [upload=24321]: Upload finished. err: <nil> Aug 8 09:09:31.326588967 (23h29m30.915933954s) [upload=24333]: Starting upload Aug 8 09:09:31.326646547 (23h29m30.915991534s) [upload=24333]: Done starting upload Aug 8 09:09:31.326703516 (23h29m30.916048513s) [upload=24333]: Uploading segments... Aug 8 09:09:31.326740537 (23h29m30.916085524s) [upload=24333]: Got next segment. Inline: true Aug 8 09:09:31.326746218 (23h29m30.916091215s) [upload=24333]: Waiting for error group managing segments... Aug 8 09:09:31.326787266 (23h29m30.916132263s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:09:31.326792266 (23h29m30.916137253s) [upload=24333]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:09:31.326795482 (23h29m30.916140469s) [upload=24333]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:09:31.593342039 (23h29m31.182687026s) [upload=24333]: Done uploading segments... Aug 8 09:09:31.593361256 (23h29m31.182706243s) [upload=24333]: Upload finished. err: <nil> Aug 8 09:10:12.631543380 (23h30m12.220888367s) [upload=24346]: Starting upload Aug 8 09:10:12.631578136 (23h30m12.220923123s) [upload=24346]: Done starting upload Aug 8 09:10:12.631629504 (23h30m12.220974481s) [upload=24346]: Uploading segments... Aug 8 09:10:12.631656296 (23h30m12.221001283s) [upload=24346]: Got next segment. Inline: true Aug 8 09:10:12.631659311 (23h30m12.221004298s) [upload=24346]: Waiting for error group managing segments... Aug 8 09:10:12.631686563 (23h30m12.22103154s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 09:10:12.631690932 (23h30m12.221035919s) [upload=24346]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 09:10:12.631693126 (23h30m12.221038113s) [upload=24346]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 09:10:12.846075276 (23h30m12.435420263s) [upload=24346]: Done uploading segments... Aug 8 09:10:12.846094392 (23h30m12.435439379s) [upload=24346]: Upload finished. err: metaclient: Too Many Requests Duration: 876.942967ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)