Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..XXX.......X..X..............................X.............] duration: 5.754768321s FAIL (2025-08-07 18:36:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 5.754788488s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........X..........X....X..................X..X............] duration: 2.061123667s FAIL (2025-08-07 18:36:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 2.06114641s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..........X..........X....X..................X..X...........] duration: 1.817813986s FAIL (2025-08-07 18:35:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 1.817834044s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...XXX.......X..X..............................X............] duration: 6.070954943s FAIL (2025-08-07 18:35:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 6.070978539s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [....XXX.......X..X..............................X...........] duration: 5.639474408s FAIL (2025-08-07 18:35:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 5.639500719s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...........X..........X....X..................X..X..........] duration: 1.965354144s FAIL (2025-08-07 18:35:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 1.965382157s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.....XXX.......X..X..............................X..........] duration: 5.672298382s FAIL (2025-08-07 18:34:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 5.672340392s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [............X..........X....X..................X..X.........] duration: 1.844959014s FAIL (2025-08-07 18:34:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 1.844987218s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [......XXX.......X..X..............................X.........] duration: 6.244318706s FAIL (2025-08-07 18:33:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 6.244335679s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.............X..........X....X..................X..X........] duration: 2.012865644s FAIL (2025-08-07 18:33:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 2.012906302s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.......XXX.......X..X..............................X........] duration: 5.788893852s FAIL (2025-08-07 18:33:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 5.788926315s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..............X..........X....X..................X..X.......] duration: 2.067887637s FAIL (2025-08-07 18:32:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 2.067908898s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [........XXX.......X..X..............................X.......] duration: 6.194529879s FAIL (2025-08-07 18:31:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 6.194587629s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...............X..........X....X..................X..X......] duration: 1.929687271s FAIL (2025-08-07 18:31:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 1.929710016s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [................X..........X....X..................X..X.....] duration: 1.892573923s FAIL (2025-08-07 18:31:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 1.892599381s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.........XXX.......X..X..............................X......] duration: 6.073138793s FAIL (2025-08-07 18:30:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 6.073165544s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.................X..........X....X..................X..X....] duration: 2.117277543s FAIL (2025-08-07 18:30:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 2.117362426s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..........XXX.......X..X..............................X.....] duration: 5.915793868s FAIL (2025-08-07 18:29:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 5.915832161s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..................X..........X....X..................X..X...] duration: 1.930079211s FAIL (2025-08-07 18:29:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 1.930111583s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...........XXX.......X..X..............................X....] duration: 6.197492567s FAIL (2025-08-07 18:29:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 6.197516633s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [............XXX.......X..X..............................X...] duration: 6.117575312s FAIL (2025-08-07 18:28:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 6.117608083s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...................X..........X....X..................X..X..] duration: 1.854995866s FAIL (2025-08-07 18:28:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 1.855026565s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.............XXX.......X..X..............................X..] duration: 5.951260446s FAIL (2025-08-07 18:27:49 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 5.95129332s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [....................X..........X....X..................X..X.] duration: 1.941806011s FAIL (2025-08-07 18:27:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 1.941841278s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..............XXX.......X..X..............................X.] duration: 6.098668257s FAIL (2025-08-07 18:27:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 6.098691121s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....................X..........X....X..................X..X] duration: 1.41243462s FAIL (2025-08-07 18:26:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== tem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Aug 7 18:25:50.704588291 (8h45m50.293933278s) [upload=9147]: Starting upload Aug 7 18:25:50.704640851 (8h45m50.293985838s) [upload=9147]: Done starting upload Aug 7 18:25:50.704696177 (8h45m50.294041164s) [upload=9147]: Uploading segments... Aug 7 18:25:50.704730282 (8h45m50.294075269s) [upload=9147]: Got next segment. Inline: true Aug 7 18:25:50.704734931 (8h45m50.294079918s) [upload=9147]: Waiting for error group managing segments... Aug 7 18:25:50.704773014 (8h45m50.294117991s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:50.704777383 (8h45m50.29412237s) [upload=9147]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:50.704780228 (8h45m50.294125215s) [upload=9147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:51.002869887 (8h45m50.592214874s) [upload=9147]: Done uploading segments... Aug 7 18:25:51.002889625 (8h45m50.592234612s) [upload=9147]: Upload finished. err: <nil> Aug 7 18:26:08.130955895 (8h46m7.720300883s) [upload=9151]: Starting upload Aug 7 18:26:08.131014027 (8h46m7.720359014s) [upload=9151]: Done starting upload Aug 7 18:26:08.131074603 (8h46m7.72041959s) [upload=9151]: Uploading segments... Aug 7 18:26:08.131162842 (8h46m7.720507829s) [upload=9151]: Got next segment. Inline: true Aug 7 18:26:08.131167481 (8h46m7.720512468s) [upload=9151]: Waiting for error group managing segments... Aug 7 18:26:08.131242595 (8h46m7.720587582s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:08.131248255 (8h46m7.720593242s) [upload=9151]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:08.131250560 (8h46m7.720595547s) [upload=9151]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:08.444422104 (8h46m8.033767091s) [upload=9151]: Done uploading segments... Aug 7 18:26:08.444441941 (8h46m8.033786928s) [upload=9151]: Upload finished. err: <nil> Aug 7 18:26:47.838396219 (8h46m47.427741206s) [upload=9165]: Starting upload Aug 7 18:26:47.838448730 (8h46m47.427793717s) [upload=9165]: Done starting upload Aug 7 18:26:47.838514316 (8h46m47.427859293s) [upload=9165]: Uploading segments... Aug 7 18:26:47.838555294 (8h46m47.427900281s) [upload=9165]: Got next segment. Inline: true Aug 7 18:26:47.838559382 (8h46m47.427904369s) [upload=9165]: Waiting for error group managing segments... Aug 7 18:26:47.838597675 (8h46m47.427942663s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:47.838602004 (8h46m47.427946991s) [upload=9165]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:26:47.838604368 (8h46m47.427949345s) [upload=9165]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:48.138048989 (8h46m47.727393976s) [upload=9165]: Done uploading segments... Aug 7 18:26:48.138067415 (8h46m47.727412402s) [upload=9165]: Upload finished. err: <nil> Duration:* 1.412465109s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...............XXX.......X..X..............................X] duration: 4.522615598s FAIL (2025-08-07 18:26:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 6s) [upload=9148]: Done uploading segments... Aug 7 18:25:54.159384652 (8h45m53.748729649s) [upload=9148]: Upload finished. err: <nil> Aug 7 18:26:33.169832626 (8h46m32.759177643s) [upload=9160]: Starting upload Aug 7 18:26:33.169913892 (8h46m32.759258879s) [upload=9160]: Done starting upload Aug 7 18:26:33.169965200 (8h46m32.759310237s) [upload=9160]: Uploading segments... Aug 7 18:26:33.170369133 (8h46m32.75971412s) [upload=9160]: Got next segment. Inline: false Aug 7 18:26:33.170414720 (8h46m32.759759707s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:26:33.170421163 (8h46m32.75976617s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:26:33.640668898 (8h46m33.230013885s) [seg_pos={0 0}, upload=9160]: Begin upload segment... Aug 7 18:26:33.640726117 (8h46m33.230071104s) [seg_pos={0 0}, upload=9160]: Done begin upload segment. Aug 7 18:26:33.640750043 (8h46m33.23009503s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.640828884 (8h46m33.230173881s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641092989 (8h46m33.230437976s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641416809 (8h46m33.230761796s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641488977 (8h46m33.230833994s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.641750397 (8h46m33.231095384s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642015404 (8h46m33.231360391s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642149691 (8h46m33.231494678s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642425559 (8h46m33.231770546s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642516272 (8h46m33.231861259s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642679474 (8h46m33.232024472s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642901199 (8h46m33.232246196s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.642936968 (8h46m33.232281955s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643183098 (8h46m33.232528085s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643268903 (8h46m33.23261389s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.643602922 (8h46m33.232947909s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.645901198 (8h46m33.235246185s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:33.646161707 (8h46m33.235506694s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Uploading piece... Aug 7 18:26:34.789273049 (8h46m34.378618036s) [upload=9160]: Next returned nil segment Aug 7 18:26:34.789292435 (8h46m34.378637412s) [upload=9160]: Waiting for error group managing segments... Aug 7 18:26:35.083384576 (8h46m34.672729563s) [noise=true , address=64.49.13.138:4488 , piece_id=LY4EF77ACU543JBNUDBF32RZXMKJB4UROJ2OSRNT2NJKPRACZE2A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.574868803 (8h46m35.16421379s) [noise=true , address=104.36.82.44:4872 , piece_id=YP7XESTUBJE5AGWJR43COAVSERFCZVCI2YFEG4YJCM4LIGJDQL4A, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.590360653 (8h46m35.17970564s) [noise=true , address=104.36.82.61:4400 , piece_id=HUFLTOBZWC5D35X67EOPX2EXNCMI727GE2GLOOAYJPVCLB3UYRFA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.608330565 (8h46m35.197675552s) [noise=true , address=45.91.116.11:4142 , piece_id=M5NRMLLWYGDOPSB2E4PY7R3XLKKV3UKEM6TKKPAPB2OYAF32SPQA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.612348191 (8h46m35.201693178s) [noise=true , address=45.91.116.7:4015 , piece_id=HC42SRFZUUQ3GMILJ5XY5K64ZEMMB2HOWOWFJGUUJQSOY2NVNMBQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.626835640 (8h46m35.216180627s) [noise=true , address=45.91.116.6:4992 , piece_id=3ZWPEWLRC4E25XNHYX5D7F6S3BF4TFA3PNDRD2OMW3GURZGAIO7Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.637824986 (8h46m35.227169973s) [noise=true , address=104.36.82.60:4338 , piece_id=FBJJTZ23FS4RKVLXD5AOPCKZZVAMADIL4HNDSGJRKKCRQX65C6QQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.641667337 (8h46m35.231012325s) [noise=true , address=104.36.82.47:4520 , piece_id=7EBGR3UXKT54K6YLGPW3VPKWPDY44G5TVIF52OPTK4ZVBE6MAVMQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.650520004 (8h46m35.239864991s) [noise=true , address=104.36.82.14:4247 , piece_id=LXSXDDBTM3VXAGNTYMXSR7NDCDF5PPFGVWTDHDDXS2CKAVTXWLKQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.700946234 (8h46m35.290291221s) [noise=true , address=104.36.82.55:4202 , piece_id=JU5V7EZPWZR334ONLZ3Z6QY7WLHPANLICMRBU4KPUQYF33FAUA2Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.734357630 (8h46m35.323702607s) [noise=true , address=104.36.82.2:4735 , piece_id=SG3EYXEKJUQIV46AMWAI35JZUZTPICWDAGUZWQUVP5PLC523LN3Q, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.750528559 (8h46m35.339873546s) [noise=true , address=104.36.82.46:4491 , piece_id=SAC7W5JSOMBAA3MFQSHAO4WH7RG5NSHNDIV6GJYGXCXTBTK3KAGQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.776081188 (8h46m35.365426175s) [noise=true , address=104.36.82.4:4830 , piece_id=AV3YVA7OK22Z533SMRACI65SBNKVGKBJHJIHOBVWRSK2EZGPNKAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778341653 (8h46m35.36768664s) [noise=true , address=104.36.82.23:4469 , piece_id=I4X74BA3SGTEBXAUUIG3JOEQCQ7KAFNNTLISZJHXOZ6VT6OSKKUA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: <nil> Aug 7 18:26:35.778355560 (8h46m35.367700547s) [seg_pos={0 0}, upload=9160]: Segment reached optimal threshold of 14 pieces. Aug 7 18:26:35.778462074 (8h46m35.367807061s) [noise=true , address=45.91.116.9:4290 , piece_id=BFYOTOL2CC7KJTLM5CWX6M2WM27JEWAZIQBF2DJNMELG2E2L7AYQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1txTbjkxQ82kwxCWNkQG4aPmVvcGARaAHxXNw1CXVTVMQFCLQ9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778519113 (8h46m35.3678641s) [noise=true , address=104.36.82.39:4748 , piece_id=UYTUCHOXFFELF6QPVUETAFC36CMMDLPNMAJ2G4XWZ4WXOCSMXRXA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1aZ4HiQxxV3qYJLYViMi7me9mRnPPBgPihW8fwzeMTKXnwbUb9): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778578506 (8h46m35.367923493s) [noise=true , address=45.91.116.14:4198 , piece_id=KEO7NKRBMZPOXIE6ONIM7Z4ZFW2XYCDXDJLQWJJ5KHZ2VOAJCZAQ, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xxfUrCm5PgSLpge1wYiH2EcE7kzzJ38P9rfeCYmqXTbTisioi): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778612932 (8h46m35.367957919s) [noise=true , address=64.49.13.169:4706 , piece_id=OGU2C22G25V34EB5TO6VLATNBI5EFMIM3MOWCGULFGN56673MEDA, seg_pos={0 0}, upload=9160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xwktmeUvkUf2wfqQTazBsknPs2aC7sj1GLqR875qcW4Cj2GD7): protocol: expected piece hash; context canceled; EOF Aug 7 18:26:35.778633211 (8h46m35.367978198s) [seg_pos={0 0}, upload=9160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:26:35.778695009 (8h46m35.368039996s) [upload=9160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:26:35.778698926 (8h46m35.368043913s) [upload=9160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:26:36.296881414 (8h46m35.886226411s) [upload=9160]: Done uploading segments... Aug 7 18:26:36.296904048 (8h46m35.886249035s) [upload=9160]: Upload finished. err: <nil> Duration: 4.522635005s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......................X..........X....X..................X..] duration: 1.900253227s FAIL (2025-08-07 18:26:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 18:16:07.089552208 (8h36m6.678897195s) [upload=8983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:16:07.380388853 (8h36m6.96973384s) [upload=8983]: Done uploading segments... Aug 7 18:16:07.380407278 (8h36m6.969752265s) [upload=8983]: Upload finished. err: <nil> Aug 7 18:17:17.227613232 (8h37m16.816958219s) [upload=9003]: Starting upload Aug 7 18:17:17.227658499 (8h37m16.817003486s) [upload=9003]: Done starting upload Aug 7 18:17:17.227719615 (8h37m16.817064602s) [upload=9003]: Uploading segments... Aug 7 18:17:17.227754954 (8h37m16.817099941s) [upload=9003]: Got next segment. Inline: true Aug 7 18:17:17.227758891 (8h37m16.817103878s) [upload=9003]: Waiting for error group managing segments... Aug 7 18:17:17.227793848 (8h37m16.817138835s) [upload=9003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:17:17.227798186 (8h37m16.817143173s) [upload=9003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:17:17.227800560 (8h37m16.817145547s) [upload=9003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:17:17.491143943 (8h37m17.08048893s) [upload=9003]: Done uploading segments... Aug 7 18:17:17.491159863 (8h37m17.08050485s) [upload=9003]: Upload finished. err: <nil> Aug 7 18:18:03.205948639 (8h38m2.795293626s) [upload=9014]: Starting upload Aug 7 18:18:03.206009716 (8h38m2.795354703s) [upload=9014]: Done starting upload Aug 7 18:18:03.206074711 (8h38m2.795419698s) [upload=9014]: Uploading segments... Aug 7 18:18:03.206143933 (8h38m2.79548892s) [upload=9014]: Got next segment. Inline: true Aug 7 18:18:03.206148762 (8h38m2.795493749s) [upload=9014]: Waiting for error group managing segments... Aug 7 18:18:03.206181635 (8h38m2.795526622s) [upload=9014]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:18:03.206187036 (8h38m2.795532023s) [upload=9014]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:18:03.206189430 (8h38m2.795534417s) [upload=9014]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:03.540587130 (8h38m3.129932107s) [upload=9014]: Done uploading segments... Aug 7 18:18:03.540605966 (8h38m3.129950953s) [upload=9014]: Upload finished. err: <nil> Aug 7 18:18:59.384882075 (8h38m58.974227062s) [upload=9029]: Starting upload Aug 7 18:18:59.384947270 (8h38m58.974292257s) [upload=9029]: Done starting upload Aug 7 18:18:59.384997797 (8h38m58.974342774s) [upload=9029]: Uploading segments... Aug 7 18:18:59.385031081 (8h38m58.974376058s) [upload=9029]: Got next segment. Inline: true Aug 7 18:18:59.385035028 (8h38m58.974380015s) [upload=9029]: Waiting for error group managing segments... Aug 7 18:18:59.385067300 (8h38m58.974412287s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:18:59.385071137 (8h38m58.974416124s) [upload=9029]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Duration:* 1.900311138s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [................XXX.......X..X..............................] duration: 6.189419402s FAIL (2025-08-07 18:25:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 6.189453217s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......................X..........X....X..................X.] duration: 1.989558241s FAIL (2025-08-07 18:25:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 18:16:07.089552208 (8h36m6.678897195s) [upload=8983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:16:07.380388853 (8h36m6.96973384s) [upload=8983]: Done uploading segments... Aug 7 18:16:07.380407278 (8h36m6.969752265s) [upload=8983]: Upload finished. err: <nil> Aug 7 18:17:17.227613232 (8h37m16.816958219s) [upload=9003]: Starting upload Aug 7 18:17:17.227658499 (8h37m16.817003486s) [upload=9003]: Done starting upload Aug 7 18:17:17.227719615 (8h37m16.817064602s) [upload=9003]: Uploading segments... Aug 7 18:17:17.227754954 (8h37m16.817099941s) [upload=9003]: Got next segment. Inline: true Aug 7 18:17:17.227758891 (8h37m16.817103878s) [upload=9003]: Waiting for error group managing segments... Aug 7 18:17:17.227793848 (8h37m16.817138835s) [upload=9003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:17:17.227798186 (8h37m16.817143173s) [upload=9003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:17:17.227800560 (8h37m16.817145547s) [upload=9003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:17:17.491143943 (8h37m17.08048893s) [upload=9003]: Done uploading segments... Aug 7 18:17:17.491159863 (8h37m17.08050485s) [upload=9003]: Upload finished. err: <nil> Aug 7 18:18:03.205948639 (8h38m2.795293626s) [upload=9014]: Starting upload Aug 7 18:18:03.206009716 (8h38m2.795354703s) [upload=9014]: Done starting upload Aug 7 18:18:03.206074711 (8h38m2.795419698s) [upload=9014]: Uploading segments... Aug 7 18:18:03.206143933 (8h38m2.79548892s) [upload=9014]: Got next segment. Inline: true Aug 7 18:18:03.206148762 (8h38m2.795493749s) [upload=9014]: Waiting for error group managing segments... Aug 7 18:18:03.206181635 (8h38m2.795526622s) [upload=9014]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:18:03.206187036 (8h38m2.795532023s) [upload=9014]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:18:03.206189430 (8h38m2.795534417s) [upload=9014]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:03.540587130 (8h38m3.129932107s) [upload=9014]: Done uploading segments... Aug 7 18:18:03.540605966 (8h38m3.129950953s) [upload=9014]: Upload finished. err: <nil> Aug 7 18:18:59.384882075 (8h38m58.974227062s) [upload=9029]: Starting upload Aug 7 18:18:59.384947270 (8h38m58.974292257s) [upload=9029]: Done starting upload Aug 7 18:18:59.384997797 (8h38m58.974342774s) [upload=9029]: Uploading segments... Aug 7 18:18:59.385031081 (8h38m58.974376058s) [upload=9029]: Got next segment. Inline: true Aug 7 18:18:59.385035028 (8h38m58.974380015s) [upload=9029]: Waiting for error group managing segments... Aug 7 18:18:59.385067300 (8h38m58.974412287s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:18:59.385071137 (8h38m58.974416124s) [upload=9029]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Duration:* 1.989585654s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........................X..........X....X..................X] duration: 1.924630085s FAIL (2025-08-07 18:25:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== uestItem_SegmentMakeInline Aug 7 18:16:07.089552208 (8h36m6.678897195s) [upload=8983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:16:07.380388853 (8h36m6.96973384s) [upload=8983]: Done uploading segments... Aug 7 18:16:07.380407278 (8h36m6.969752265s) [upload=8983]: Upload finished. err: <nil> Aug 7 18:17:17.227613232 (8h37m16.816958219s) [upload=9003]: Starting upload Aug 7 18:17:17.227658499 (8h37m16.817003486s) [upload=9003]: Done starting upload Aug 7 18:17:17.227719615 (8h37m16.817064602s) [upload=9003]: Uploading segments... Aug 7 18:17:17.227754954 (8h37m16.817099941s) [upload=9003]: Got next segment. Inline: true Aug 7 18:17:17.227758891 (8h37m16.817103878s) [upload=9003]: Waiting for error group managing segments... Aug 7 18:17:17.227793848 (8h37m16.817138835s) [upload=9003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:17:17.227798186 (8h37m16.817143173s) [upload=9003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:17:17.227800560 (8h37m16.817145547s) [upload=9003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:17:17.491143943 (8h37m17.08048893s) [upload=9003]: Done uploading segments... Aug 7 18:17:17.491159863 (8h37m17.08050485s) [upload=9003]: Upload finished. err: <nil> Aug 7 18:18:03.205948639 (8h38m2.795293626s) [upload=9014]: Starting upload Aug 7 18:18:03.206009716 (8h38m2.795354703s) [upload=9014]: Done starting upload Aug 7 18:18:03.206074711 (8h38m2.795419698s) [upload=9014]: Uploading segments... Aug 7 18:18:03.206143933 (8h38m2.79548892s) [upload=9014]: Got next segment. Inline: true Aug 7 18:18:03.206148762 (8h38m2.795493749s) [upload=9014]: Waiting for error group managing segments... Aug 7 18:18:03.206181635 (8h38m2.795526622s) [upload=9014]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:18:03.206187036 (8h38m2.795532023s) [upload=9014]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:18:03.206189430 (8h38m2.795534417s) [upload=9014]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:03.540587130 (8h38m3.129932107s) [upload=9014]: Done uploading segments... Aug 7 18:18:03.540605966 (8h38m3.129950953s) [upload=9014]: Upload finished. err: <nil> Aug 7 18:18:59.384882075 (8h38m58.974227062s) [upload=9029]: Starting upload Aug 7 18:18:59.384947270 (8h38m58.974292257s) [upload=9029]: Done starting upload Aug 7 18:18:59.384997797 (8h38m58.974342774s) [upload=9029]: Uploading segments... Aug 7 18:18:59.385031081 (8h38m58.974376058s) [upload=9029]: Got next segment. Inline: true Aug 7 18:18:59.385035028 (8h38m58.974380015s) [upload=9029]: Waiting for error group managing segments... Aug 7 18:18:59.385067300 (8h38m58.974412287s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:18:59.385071137 (8h38m58.974416124s) [upload=9029]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:18:59.385073381 (8h38m58.974418368s) [upload=9029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:18:59.836830694 (8h38m59.426175671s) [upload=9029]: Done uploading segments... Aug 7 18:18:59.836842105 (8h38m59.426187082s) [upload=9029]: Upload finished. err: <nil> Aug 7 18:19:55.978675692 (8h39m55.568020669s) [upload=9048]: Starting upload Aug 7 18:19:55.978719566 (8h39m55.568064543s) [upload=9048]: Done starting upload Aug 7 18:19:55.978777527 (8h39m55.568122514s) [upload=9048]: Uploading segments... Aug 7 18:19:55.978860987 (8h39m55.568205974s) [upload=9048]: Got next segment. Inline: true Aug 7 18:19:55.978867118 (8h39m55.568212105s) [upload=9048]: Waiting for error group managing segments... Aug 7 18:19:55.978910782 (8h39m55.568255769s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:19:55.978915271 (8h39m55.568260258s) [upload=9048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:19:55.978917665 (8h39m55.568262652s) [upload=9048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:19:56.332489991 (8h39m55.921834978s) [upload=9048]: Done uploading segments... Aug 7 18:19:56.332507625 (8h39m55.921852612s) [upload=9048]: Upload finished. err: <nil> Aug 7 18:20:52.377551293 (8h40m51.96689628s) [upload=9064]: Starting upload Aug 7 18:20:52.377592342 (8h40m51.966937329s) [upload=9064]: Done starting upload Aug 7 18:20:52.377637598 (8h40m51.966982585s) [upload=9064]: Uploading segments... Aug 7 18:20:52.377675171 (8h40m51.967020158s) [upload=9064]: Got next segment. Inline: true Aug 7 18:20:52.377678797 (8h40m51.967023774s) [upload=9064]: Waiting for error group managing segments... Aug 7 18:20:52.377708975 (8h40m51.967053962s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:20:52.377712792 (8h40m51.967057769s) [upload=9064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:20:52.377715036 (8h40m51.967060023s) [upload=9064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:20:52.652083754 (8h40m52.241428741s) [upload=9064]: Done uploading segments... Aug 7 18:20:52.652102029 (8h40m52.241447016s) [upload=9064]: Upload finished. err: <nil> Aug 7 18:21:16.258417649 (8h41m15.847762637s) [upload=9071]: Starting upload Aug 7 18:21:16.258470240 (8h41m15.847815227s) [upload=9071]: Done starting upload Aug 7 18:21:16.258517331 (8h41m15.847862318s) [upload=9071]: Uploading segments... Aug 7 18:21:16.258547188 (8h41m15.847892175s) [upload=9071]: Got next segment. Inline: true Aug 7 18:21:16.258551095 (8h41m15.847896082s) [upload=9071]: Waiting for error group managing segments... Aug 7 18:21:16.258584398 (8h41m15.847929386s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:21:16.258588457 (8h41m15.847933434s) [upload=9071]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:21:16.258592274 (8h41m15.847937261s) [upload=9071]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:21:16.584917890 (8h41m16.174262877s) [upload=9071]: Done uploading segments... Aug 7 18:21:16.584935794 (8h41m16.174280781s) [upload=9071]: Upload finished. err: <nil> Aug 7 18:22:30.133655367 (8h42m29.723000344s) [upload=9091]: Starting upload Aug 7 18:22:30.133700805 (8h42m29.723045792s) [upload=9091]: Done starting upload Aug 7 18:22:30.133756211 (8h42m29.723101198s) [upload=9091]: Uploading segments... Aug 7 18:22:30.133813220 (8h42m29.723158197s) [upload=9091]: Got next segment. Inline: true Aug 7 18:22:30.133817898 (8h42m29.723162875s) [upload=9091]: Waiting for error group managing segments... Aug 7 18:22:30.133853997 (8h42m29.723198974s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:22:30.133858976 (8h42m29.723203964s) [upload=9091]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:22:30.133863456 (8h42m29.723208443s) [upload=9091]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:22:30.556045482 (8h42m30.145390469s) [upload=9091]: Done uploading segments... Aug 7 18:22:30.556062985 (8h42m30.145407972s) [upload=9091]: Upload finished. err: <nil> Aug 7 18:23:19.774992122 (8h43m19.364337109s) [upload=9104]: Starting upload Aug 7 18:23:19.775049882 (8h43m19.364394869s) [upload=9104]: Done starting upload Aug 7 18:23:19.775174622 (8h43m19.364519679s) [upload=9104]: Uploading segments... Aug 7 18:23:19.775227963 (8h43m19.36457297s) [upload=9104]: Got next segment. Inline: true Aug 7 18:23:19.775233304 (8h43m19.364578291s) [upload=9104]: Waiting for error group managing segments... Aug 7 18:23:19.775281165 (8h43m19.364626142s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:23:19.775284722 (8h43m19.364629709s) [upload=9104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:23:19.775286916 (8h43m19.364631903s) [upload=9104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:23:20.043289282 (8h43m19.632634269s) [upload=9104]: Done uploading segments... Aug 7 18:23:20.043308298 (8h43m19.632653285s) [upload=9104]: Upload finished. err: <nil> Aug 7 18:24:26.483455972 (8h44m26.072800959s) [upload=9124]: Starting upload Aug 7 18:24:26.483493925 (8h44m26.072838912s) [upload=9124]: Done starting upload Aug 7 18:24:26.483552617 (8h44m26.072897604s) [upload=9124]: Uploading segments... Aug 7 18:24:26.483582775 (8h44m26.072927762s) [upload=9124]: Got next segment. Inline: true Aug 7 18:24:26.483586783 (8h44m26.07293177s) [upload=9124]: Waiting for error group managing segments... Aug 7 18:24:26.483629484 (8h44m26.072974471s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:24:26.483633532 (8h44m26.072978519s) [upload=9124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:24:26.483635967 (8h44m26.072980954s) [upload=9124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:24:26.769723204 (8h44m26.359068201s) [upload=9124]: Done uploading segments... Aug 7 18:24:26.769745517 (8h44m26.359090524s) [upload=9124]: Upload finished. err: <nil> Aug 7 18:25:20.811256376 (8h45m20.400601353s) [upload=9139]: Starting upload Aug 7 18:25:20.811319787 (8h45m20.400664774s) [upload=9139]: Done starting upload Aug 7 18:25:20.811366817 (8h45m20.400711804s) [upload=9139]: Uploading segments... Aug 7 18:25:20.811396714 (8h45m20.400741701s) [upload=9139]: Got next segment. Inline: true Aug 7 18:25:20.811400431 (8h45m20.400745418s) [upload=9139]: Waiting for error group managing segments... Aug 7 18:25:20.811433375 (8h45m20.400778362s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:25:20.811436921 (8h45m20.400781898s) [upload=9139]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:25:20.811439186 (8h45m20.400784173s) [upload=9139]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:25:21.620412739 (8h45m21.209757726s) [upload=9139]: Done uploading segments... Aug 7 18:25:21.620431675 (8h45m21.209776662s) [upload=9139]: Upload finished. err: <nil> Duration:* 1.92465824s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.................XXX.......X..X.............................] duration: 5.566438309s FAIL (2025-08-07 18:24:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 5.566463998s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X..........X....X..................] duration: 1.847787333s FAIL (2025-08-07 18:24:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== pb.BatchRequestItem_SegmentMakeInline Aug 7 18:02:58.324202419 (8h22m57.913547406s) [upload=8751]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:02:58.698491093 (8h22m58.28783608s) [upload=8751]: Done uploading segments... Aug 7 18:02:58.698512194 (8h22m58.287857181s) [upload=8751]: Upload finished. err: <nil> Aug 7 18:03:34.023713956 (8h23m33.613058943s) [upload=8762]: Starting upload Aug 7 18:03:34.023756718 (8h23m33.613101705s) [upload=8762]: Done starting upload Aug 7 18:03:34.023810802 (8h23m33.613155789s) [upload=8762]: Uploading segments... Aug 7 18:03:34.023849966 (8h23m33.613194953s) [upload=8762]: Got next segment. Inline: true Aug 7 18:03:34.023854666 (8h23m33.613199653s) [upload=8762]: Waiting for error group managing segments... Aug 7 18:03:34.023897628 (8h23m33.613242615s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:34.023901234 (8h23m33.613246211s) [upload=8762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:34.023903569 (8h23m33.613248556s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:34.301041444 (8h23m33.890386431s) [upload=8762]: Done uploading segments... Aug 7 18:03:34.301059288 (8h23m33.890404275s) [upload=8762]: Upload finished. err: <nil> Aug 7 18:03:59.853483337 (8h23m59.442828324s) [upload=8770]: Starting upload Aug 7 18:03:59.853529155 (8h23m59.442874142s) [upload=8770]: Done starting upload Aug 7 18:03:59.853588008 (8h23m59.442932995s) [upload=8770]: Uploading segments... Aug 7 18:03:59.853685885 (8h23m59.443030902s) [upload=8770]: Got next segment. Inline: true Aug 7 18:03:59.853694351 (8h23m59.443039338s) [upload=8770]: Waiting for error group managing segments... Aug 7 18:03:59.853789563 (8h23m59.44313455s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:59.853811105 (8h23m59.443156092s) [upload=8770]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:59.853813669 (8h23m59.443158656s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:04:00.248702898 (8h23m59.838047905s) [upload=8770]: Done uploading segments... Aug 7 18:04:00.248729179 (8h23m59.838074166s) [upload=8770]: Upload finished. err: <nil> Aug 7 18:05:11.288723553 (8h25m10.87806854s) [upload=8792]: Starting upload Aug 7 18:05:11.288768570 (8h25m10.878113557s) [upload=8792]: Done starting upload Aug 7 18:05:11.288821371 (8h25m10.878166358s) [upload=8792]: Uploading segments... Aug 7 18:05:11.288853282 (8h25m10.878198269s) [upload=8792]: Got next segment. Inline: true Aug 7 18:05:11.288856989 (8h25m10.878201976s) [upload=8792]: Waiting for error group managing segments... Aug 7 18:05:11.288889871 (8h25m10.878234858s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:11.288894972 (8h25m10.878239969s) [upload=8792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:11.288897246 (8h25m10.878242233s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:11.633494661 (8h25m11.222839648s) [upload=8792]: Done uploading segments... Aug 7 18:05:11.633511834 (8h25m11.222856821s) [upload=8792]: Upload finished. err: <nil> Aug 7 18:05:46.281330062 (8h25m45.870675059s) [upload=8802]: Starting upload Aug 7 18:05:46.281387371 (8h25m45.870732358s) [upload=8802]: Done starting upload Aug 7 18:05:46.281445092 (8h25m45.870790079s) [upload=8802]: Uploading segments... Aug 7 18:05:46.281475491 (8h25m45.870820478s) [upload=8802]: Got next segment. Inline: true Aug 7 18:05:46.281479218 (8h25m45.870824205s) [upload=8802]: Waiting for error group managing segments... Aug 7 18:05:46.281513543 (8h25m45.87085853s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:46.281517781 (8h25m45.870862768s) [upload=8802]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:46.281520146 (8h25m45.870865133s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:46.556872305 (8h25m46.146217292s) [upload=8802]: Done uploading segments... Aug 7 18:05:46.556891452 (8h25m46.146236439s) [upload=8802]: Upload finished. err: <nil> Aug 7 18:06:26.963610183 (8h26m26.55295517s) [upload=8814]: Starting upload Aug 7 18:06:26.963657103 (8h26m26.55300209s) [upload=8814]: Done starting upload Aug 7 18:06:26.963737527 (8h26m26.553082514s) [upload=8814]: Uploading segments... Aug 7 18:06:26.963867786 (8h26m26.553212783s) [upload=8814]: Got next segment. Inline: true Aug 7 18:06:26.963874910 (8h26m26.553219897s) [upload=8814]: Waiting for error group managing segments... Aug 7 18:06:26.963927700 (8h26m26.553272687s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:26.963934554 (8h26m26.553279541s) [upload=8814]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:26.963937970 (8h26m26.553282957s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:27.258606837 (8h26m26.847951824s) [upload=8814]: Done uploading segments... Aug 7 18:06:27.258625452 (8h26m26.84797044s) [upload=8814]: Upload finished. err: <nil> Aug 7 18:06:58.759713181 (8h26m58.349058158s) [upload=8824]: Starting upload Aug 7 18:06:58.759765702 (8h26m58.349110689s) [upload=8824]: Done starting upload Aug 7 18:06:58.759814064 (8h26m58.349159052s) [upload=8824]: Uploading segments... Aug 7 18:06:58.759845304 (8h26m58.349190291s) [upload=8824]: Got next segment. Inline: true Aug 7 18:06:58.759849382 (8h26m58.349194369s) [upload=8824]: Waiting for error group managing segments... Aug 7 18:06:58.759883998 (8h26m58.349228985s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:58.759888256 (8h26m58.349233243s) [upload=8824]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:58.759892514 (8h26m58.349237501s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:59.029430588 (8h26m58.618775575s) [upload=8824]: Done uploading segments... Aug 7 18:06:59.029447962 (8h26m58.618792949s) [upload=8824]: Upload finished. err: <nil> Aug 7 18:07:21.849459220 (8h27m21.438804207s) [upload=8832]: Starting upload Aug 7 18:07:21.849502753 (8h27m21.43884774s) [upload=8832]: Done starting upload Aug 7 18:07:21.849555023 (8h27m21.43890001s) [upload=8832]: Uploading segments... Aug 7 18:07:21.849584629 (8h27m21.438929606s) [upload=8832]: Got next segment. Inline: true Aug 7 18:07:21.849588207 (8h27m21.438933194s) [upload=8832]: Waiting for error group managing segments... Aug 7 18:07:21.849642782 (8h27m21.438987769s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:07:21.849646969 (8h27m21.438991946s) [upload=8832]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:07:21.849649234 (8h27m21.438994221s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:07:22.125155216 (8h27m21.714500193s) [upload=8832]: Done uploading segments... Aug 7 18:07:22.125168983 (8h27m21.71451397s) [upload=8832]: Upload finished. err: <nil> Aug 7 18:08:04.258700436 (8h28m3.848045423s) [upload=8844]: Starting upload Aug 7 18:08:04.258764518 (8h28m3.848109505s) [upload=8844]: Done starting upload Aug 7 18:08:04.258817950 (8h28m3.848162937s) [upload=8844]: Uploading segments... Aug 7 18:08:04.258851825 (8h28m3.848196812s) [upload=8844]: Got next segment. Inline: true Aug 7 18:08:04.258856134 (8h28m3.848201121s) [upload=8844]: Waiting for error group managing segments... Aug 7 18:08:04.258889087 (8h28m3.848234074s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:08:04.258893615 (8h28m3.848238602s) [upload=8844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:08:04.258896881 (8h28m3.848241868s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:08:04.739572923 (8h28m4.32891791s) [upload=8844]: Done uploading segments... Aug 7 18:08:04.739591489 (8h28m4.328936476s) [upload=8844]: Upload finished. err: <nil> Aug 7 18:09:08.962290352 (8h29m8.551635339s) [upload=8862]: Starting upload Aug 7 18:09:08.962325299 (8h29m8.551670286s) [upload=8862]: Done starting upload Aug 7 18:09:08.962367259 (8h29m8.551712246s) [upload=8862]: Uploading segments... Aug 7 18:09:08.962397838 (8h29m8.551742825s) [upload=8862]: Got next segment. Inline: true Aug 7 18:09:08.962401585 (8h29m8.551746572s) [upload=8862]: Waiting for error group managing segments... Aug 7 18:09:08.962444857 (8h29m8.551789844s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:08.962449055 (8h29m8.551794042s) [upload=8862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:08.962451691 (8h29m8.551796678s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:09.256530018 (8h29m8.845875005s) [upload=8862]: Done uploading segments... Aug 7 18:09:09.256598799 (8h29m8.845943796s) [upload=8862]: Upload finished. err: <nil> Aug 7 18:09:53.903185086 (8h29m53.492530073s) [upload=8874]: Starting upload Aug 7 18:09:53.903229430 (8h29m53.492574417s) [upload=8874]: Done starting upload Aug 7 18:09:53.903289726 (8h29m53.492634714s) [upload=8874]: Uploading segments... Aug 7 18:09:53.903323862 (8h29m53.492668849s) [upload=8874]: Got next segment. Inline: true Aug 7 18:09:53.903327488 (8h29m53.492672465s) [upload=8874]: Waiting for error group managing segments... Aug 7 18:09:53.903359990 (8h29m53.492704977s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:53.903363988 (8h29m53.492708975s) [upload=8874]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:53.903366563 (8h29m53.49271154s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:54.205270072 (8h29m53.794615059s) [upload=8874]: Done uploading segments... Aug 7 18:09:54.205287746 (8h29m53.794632733s) [upload=8874]: Upload finished. err: <nil> Duration: 1.847815456s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..................XXX.......X..X............................] duration: 5.688930843s FAIL (2025-08-07 18:24:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 5.688952064s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X..........X....X.................] duration: 1.960097364s FAIL (2025-08-07 18:23:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== pb.BatchRequestItem_SegmentMakeInline Aug 7 18:02:58.324202419 (8h22m57.913547406s) [upload=8751]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:02:58.698491093 (8h22m58.28783608s) [upload=8751]: Done uploading segments... Aug 7 18:02:58.698512194 (8h22m58.287857181s) [upload=8751]: Upload finished. err: <nil> Aug 7 18:03:34.023713956 (8h23m33.613058943s) [upload=8762]: Starting upload Aug 7 18:03:34.023756718 (8h23m33.613101705s) [upload=8762]: Done starting upload Aug 7 18:03:34.023810802 (8h23m33.613155789s) [upload=8762]: Uploading segments... Aug 7 18:03:34.023849966 (8h23m33.613194953s) [upload=8762]: Got next segment. Inline: true Aug 7 18:03:34.023854666 (8h23m33.613199653s) [upload=8762]: Waiting for error group managing segments... Aug 7 18:03:34.023897628 (8h23m33.613242615s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:34.023901234 (8h23m33.613246211s) [upload=8762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:34.023903569 (8h23m33.613248556s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:34.301041444 (8h23m33.890386431s) [upload=8762]: Done uploading segments... Aug 7 18:03:34.301059288 (8h23m33.890404275s) [upload=8762]: Upload finished. err: <nil> Aug 7 18:03:59.853483337 (8h23m59.442828324s) [upload=8770]: Starting upload Aug 7 18:03:59.853529155 (8h23m59.442874142s) [upload=8770]: Done starting upload Aug 7 18:03:59.853588008 (8h23m59.442932995s) [upload=8770]: Uploading segments... Aug 7 18:03:59.853685885 (8h23m59.443030902s) [upload=8770]: Got next segment. Inline: true Aug 7 18:03:59.853694351 (8h23m59.443039338s) [upload=8770]: Waiting for error group managing segments... Aug 7 18:03:59.853789563 (8h23m59.44313455s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:59.853811105 (8h23m59.443156092s) [upload=8770]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:59.853813669 (8h23m59.443158656s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:04:00.248702898 (8h23m59.838047905s) [upload=8770]: Done uploading segments... Aug 7 18:04:00.248729179 (8h23m59.838074166s) [upload=8770]: Upload finished. err: <nil> Aug 7 18:05:11.288723553 (8h25m10.87806854s) [upload=8792]: Starting upload Aug 7 18:05:11.288768570 (8h25m10.878113557s) [upload=8792]: Done starting upload Aug 7 18:05:11.288821371 (8h25m10.878166358s) [upload=8792]: Uploading segments... Aug 7 18:05:11.288853282 (8h25m10.878198269s) [upload=8792]: Got next segment. Inline: true Aug 7 18:05:11.288856989 (8h25m10.878201976s) [upload=8792]: Waiting for error group managing segments... Aug 7 18:05:11.288889871 (8h25m10.878234858s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:11.288894972 (8h25m10.878239969s) [upload=8792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:11.288897246 (8h25m10.878242233s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:11.633494661 (8h25m11.222839648s) [upload=8792]: Done uploading segments... Aug 7 18:05:11.633511834 (8h25m11.222856821s) [upload=8792]: Upload finished. err: <nil> Aug 7 18:05:46.281330062 (8h25m45.870675059s) [upload=8802]: Starting upload Aug 7 18:05:46.281387371 (8h25m45.870732358s) [upload=8802]: Done starting upload Aug 7 18:05:46.281445092 (8h25m45.870790079s) [upload=8802]: Uploading segments... Aug 7 18:05:46.281475491 (8h25m45.870820478s) [upload=8802]: Got next segment. Inline: true Aug 7 18:05:46.281479218 (8h25m45.870824205s) [upload=8802]: Waiting for error group managing segments... Aug 7 18:05:46.281513543 (8h25m45.87085853s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:46.281517781 (8h25m45.870862768s) [upload=8802]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:46.281520146 (8h25m45.870865133s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:46.556872305 (8h25m46.146217292s) [upload=8802]: Done uploading segments... Aug 7 18:05:46.556891452 (8h25m46.146236439s) [upload=8802]: Upload finished. err: <nil> Aug 7 18:06:26.963610183 (8h26m26.55295517s) [upload=8814]: Starting upload Aug 7 18:06:26.963657103 (8h26m26.55300209s) [upload=8814]: Done starting upload Aug 7 18:06:26.963737527 (8h26m26.553082514s) [upload=8814]: Uploading segments... Aug 7 18:06:26.963867786 (8h26m26.553212783s) [upload=8814]: Got next segment. Inline: true Aug 7 18:06:26.963874910 (8h26m26.553219897s) [upload=8814]: Waiting for error group managing segments... Aug 7 18:06:26.963927700 (8h26m26.553272687s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:26.963934554 (8h26m26.553279541s) [upload=8814]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:26.963937970 (8h26m26.553282957s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:27.258606837 (8h26m26.847951824s) [upload=8814]: Done uploading segments... Aug 7 18:06:27.258625452 (8h26m26.84797044s) [upload=8814]: Upload finished. err: <nil> Aug 7 18:06:58.759713181 (8h26m58.349058158s) [upload=8824]: Starting upload Aug 7 18:06:58.759765702 (8h26m58.349110689s) [upload=8824]: Done starting upload Aug 7 18:06:58.759814064 (8h26m58.349159052s) [upload=8824]: Uploading segments... Aug 7 18:06:58.759845304 (8h26m58.349190291s) [upload=8824]: Got next segment. Inline: true Aug 7 18:06:58.759849382 (8h26m58.349194369s) [upload=8824]: Waiting for error group managing segments... Aug 7 18:06:58.759883998 (8h26m58.349228985s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:58.759888256 (8h26m58.349233243s) [upload=8824]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:58.759892514 (8h26m58.349237501s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:59.029430588 (8h26m58.618775575s) [upload=8824]: Done uploading segments... Aug 7 18:06:59.029447962 (8h26m58.618792949s) [upload=8824]: Upload finished. err: <nil> Aug 7 18:07:21.849459220 (8h27m21.438804207s) [upload=8832]: Starting upload Aug 7 18:07:21.849502753 (8h27m21.43884774s) [upload=8832]: Done starting upload Aug 7 18:07:21.849555023 (8h27m21.43890001s) [upload=8832]: Uploading segments... Aug 7 18:07:21.849584629 (8h27m21.438929606s) [upload=8832]: Got next segment. Inline: true Aug 7 18:07:21.849588207 (8h27m21.438933194s) [upload=8832]: Waiting for error group managing segments... Aug 7 18:07:21.849642782 (8h27m21.438987769s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:07:21.849646969 (8h27m21.438991946s) [upload=8832]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:07:21.849649234 (8h27m21.438994221s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:07:22.125155216 (8h27m21.714500193s) [upload=8832]: Done uploading segments... Aug 7 18:07:22.125168983 (8h27m21.71451397s) [upload=8832]: Upload finished. err: <nil> Aug 7 18:08:04.258700436 (8h28m3.848045423s) [upload=8844]: Starting upload Aug 7 18:08:04.258764518 (8h28m3.848109505s) [upload=8844]: Done starting upload Aug 7 18:08:04.258817950 (8h28m3.848162937s) [upload=8844]: Uploading segments... Aug 7 18:08:04.258851825 (8h28m3.848196812s) [upload=8844]: Got next segment. Inline: true Aug 7 18:08:04.258856134 (8h28m3.848201121s) [upload=8844]: Waiting for error group managing segments... Aug 7 18:08:04.258889087 (8h28m3.848234074s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:08:04.258893615 (8h28m3.848238602s) [upload=8844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:08:04.258896881 (8h28m3.848241868s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:08:04.739572923 (8h28m4.32891791s) [upload=8844]: Done uploading segments... Aug 7 18:08:04.739591489 (8h28m4.328936476s) [upload=8844]: Upload finished. err: <nil> Aug 7 18:09:08.962290352 (8h29m8.551635339s) [upload=8862]: Starting upload Aug 7 18:09:08.962325299 (8h29m8.551670286s) [upload=8862]: Done starting upload Aug 7 18:09:08.962367259 (8h29m8.551712246s) [upload=8862]: Uploading segments... Aug 7 18:09:08.962397838 (8h29m8.551742825s) [upload=8862]: Got next segment. Inline: true Aug 7 18:09:08.962401585 (8h29m8.551746572s) [upload=8862]: Waiting for error group managing segments... Aug 7 18:09:08.962444857 (8h29m8.551789844s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:08.962449055 (8h29m8.551794042s) [upload=8862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:08.962451691 (8h29m8.551796678s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:09.256530018 (8h29m8.845875005s) [upload=8862]: Done uploading segments... Aug 7 18:09:09.256598799 (8h29m8.845943796s) [upload=8862]: Upload finished. err: <nil> Aug 7 18:09:53.903185086 (8h29m53.492530073s) [upload=8874]: Starting upload Aug 7 18:09:53.903229430 (8h29m53.492574417s) [upload=8874]: Done starting upload Aug 7 18:09:53.903289726 (8h29m53.492634714s) [upload=8874]: Uploading segments... Aug 7 18:09:53.903323862 (8h29m53.492668849s) [upload=8874]: Got next segment. Inline: true Aug 7 18:09:53.903327488 (8h29m53.492672465s) [upload=8874]: Waiting for error group managing segments... Aug 7 18:09:53.903359990 (8h29m53.492704977s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:53.903363988 (8h29m53.492708975s) [upload=8874]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:53.903366563 (8h29m53.49271154s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:54.205270072 (8h29m53.794615059s) [upload=8874]: Done uploading segments... Aug 7 18:09:54.205287746 (8h29m53.794632733s) [upload=8874]: Upload finished. err: <nil> Duration: 1.960122402s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...................XXX.......X..X...........................] duration: 5.556396687s FAIL (2025-08-07 18:23:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 5.556424592s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X..........X....X................] duration: 1.992053417s FAIL (2025-08-07 18:22:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== pb.BatchRequestItem_SegmentMakeInline Aug 7 18:02:58.324202419 (8h22m57.913547406s) [upload=8751]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:02:58.698491093 (8h22m58.28783608s) [upload=8751]: Done uploading segments... Aug 7 18:02:58.698512194 (8h22m58.287857181s) [upload=8751]: Upload finished. err: <nil> Aug 7 18:03:34.023713956 (8h23m33.613058943s) [upload=8762]: Starting upload Aug 7 18:03:34.023756718 (8h23m33.613101705s) [upload=8762]: Done starting upload Aug 7 18:03:34.023810802 (8h23m33.613155789s) [upload=8762]: Uploading segments... Aug 7 18:03:34.023849966 (8h23m33.613194953s) [upload=8762]: Got next segment. Inline: true Aug 7 18:03:34.023854666 (8h23m33.613199653s) [upload=8762]: Waiting for error group managing segments... Aug 7 18:03:34.023897628 (8h23m33.613242615s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:34.023901234 (8h23m33.613246211s) [upload=8762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:34.023903569 (8h23m33.613248556s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:34.301041444 (8h23m33.890386431s) [upload=8762]: Done uploading segments... Aug 7 18:03:34.301059288 (8h23m33.890404275s) [upload=8762]: Upload finished. err: <nil> Aug 7 18:03:59.853483337 (8h23m59.442828324s) [upload=8770]: Starting upload Aug 7 18:03:59.853529155 (8h23m59.442874142s) [upload=8770]: Done starting upload Aug 7 18:03:59.853588008 (8h23m59.442932995s) [upload=8770]: Uploading segments... Aug 7 18:03:59.853685885 (8h23m59.443030902s) [upload=8770]: Got next segment. Inline: true Aug 7 18:03:59.853694351 (8h23m59.443039338s) [upload=8770]: Waiting for error group managing segments... Aug 7 18:03:59.853789563 (8h23m59.44313455s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:59.853811105 (8h23m59.443156092s) [upload=8770]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:59.853813669 (8h23m59.443158656s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:04:00.248702898 (8h23m59.838047905s) [upload=8770]: Done uploading segments... Aug 7 18:04:00.248729179 (8h23m59.838074166s) [upload=8770]: Upload finished. err: <nil> Aug 7 18:05:11.288723553 (8h25m10.87806854s) [upload=8792]: Starting upload Aug 7 18:05:11.288768570 (8h25m10.878113557s) [upload=8792]: Done starting upload Aug 7 18:05:11.288821371 (8h25m10.878166358s) [upload=8792]: Uploading segments... Aug 7 18:05:11.288853282 (8h25m10.878198269s) [upload=8792]: Got next segment. Inline: true Aug 7 18:05:11.288856989 (8h25m10.878201976s) [upload=8792]: Waiting for error group managing segments... Aug 7 18:05:11.288889871 (8h25m10.878234858s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:11.288894972 (8h25m10.878239969s) [upload=8792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:11.288897246 (8h25m10.878242233s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:11.633494661 (8h25m11.222839648s) [upload=8792]: Done uploading segments... Aug 7 18:05:11.633511834 (8h25m11.222856821s) [upload=8792]: Upload finished. err: <nil> Aug 7 18:05:46.281330062 (8h25m45.870675059s) [upload=8802]: Starting upload Aug 7 18:05:46.281387371 (8h25m45.870732358s) [upload=8802]: Done starting upload Aug 7 18:05:46.281445092 (8h25m45.870790079s) [upload=8802]: Uploading segments... Aug 7 18:05:46.281475491 (8h25m45.870820478s) [upload=8802]: Got next segment. Inline: true Aug 7 18:05:46.281479218 (8h25m45.870824205s) [upload=8802]: Waiting for error group managing segments... Aug 7 18:05:46.281513543 (8h25m45.87085853s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:46.281517781 (8h25m45.870862768s) [upload=8802]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:46.281520146 (8h25m45.870865133s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:46.556872305 (8h25m46.146217292s) [upload=8802]: Done uploading segments... Aug 7 18:05:46.556891452 (8h25m46.146236439s) [upload=8802]: Upload finished. err: <nil> Aug 7 18:06:26.963610183 (8h26m26.55295517s) [upload=8814]: Starting upload Aug 7 18:06:26.963657103 (8h26m26.55300209s) [upload=8814]: Done starting upload Aug 7 18:06:26.963737527 (8h26m26.553082514s) [upload=8814]: Uploading segments... Aug 7 18:06:26.963867786 (8h26m26.553212783s) [upload=8814]: Got next segment. Inline: true Aug 7 18:06:26.963874910 (8h26m26.553219897s) [upload=8814]: Waiting for error group managing segments... Aug 7 18:06:26.963927700 (8h26m26.553272687s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:26.963934554 (8h26m26.553279541s) [upload=8814]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:26.963937970 (8h26m26.553282957s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:27.258606837 (8h26m26.847951824s) [upload=8814]: Done uploading segments... Aug 7 18:06:27.258625452 (8h26m26.84797044s) [upload=8814]: Upload finished. err: <nil> Aug 7 18:06:58.759713181 (8h26m58.349058158s) [upload=8824]: Starting upload Aug 7 18:06:58.759765702 (8h26m58.349110689s) [upload=8824]: Done starting upload Aug 7 18:06:58.759814064 (8h26m58.349159052s) [upload=8824]: Uploading segments... Aug 7 18:06:58.759845304 (8h26m58.349190291s) [upload=8824]: Got next segment. Inline: true Aug 7 18:06:58.759849382 (8h26m58.349194369s) [upload=8824]: Waiting for error group managing segments... Aug 7 18:06:58.759883998 (8h26m58.349228985s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:58.759888256 (8h26m58.349233243s) [upload=8824]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:58.759892514 (8h26m58.349237501s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:59.029430588 (8h26m58.618775575s) [upload=8824]: Done uploading segments... Aug 7 18:06:59.029447962 (8h26m58.618792949s) [upload=8824]: Upload finished. err: <nil> Aug 7 18:07:21.849459220 (8h27m21.438804207s) [upload=8832]: Starting upload Aug 7 18:07:21.849502753 (8h27m21.43884774s) [upload=8832]: Done starting upload Aug 7 18:07:21.849555023 (8h27m21.43890001s) [upload=8832]: Uploading segments... Aug 7 18:07:21.849584629 (8h27m21.438929606s) [upload=8832]: Got next segment. Inline: true Aug 7 18:07:21.849588207 (8h27m21.438933194s) [upload=8832]: Waiting for error group managing segments... Aug 7 18:07:21.849642782 (8h27m21.438987769s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:07:21.849646969 (8h27m21.438991946s) [upload=8832]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:07:21.849649234 (8h27m21.438994221s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:07:22.125155216 (8h27m21.714500193s) [upload=8832]: Done uploading segments... Aug 7 18:07:22.125168983 (8h27m21.71451397s) [upload=8832]: Upload finished. err: <nil> Aug 7 18:08:04.258700436 (8h28m3.848045423s) [upload=8844]: Starting upload Aug 7 18:08:04.258764518 (8h28m3.848109505s) [upload=8844]: Done starting upload Aug 7 18:08:04.258817950 (8h28m3.848162937s) [upload=8844]: Uploading segments... Aug 7 18:08:04.258851825 (8h28m3.848196812s) [upload=8844]: Got next segment. Inline: true Aug 7 18:08:04.258856134 (8h28m3.848201121s) [upload=8844]: Waiting for error group managing segments... Aug 7 18:08:04.258889087 (8h28m3.848234074s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:08:04.258893615 (8h28m3.848238602s) [upload=8844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:08:04.258896881 (8h28m3.848241868s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:08:04.739572923 (8h28m4.32891791s) [upload=8844]: Done uploading segments... Aug 7 18:08:04.739591489 (8h28m4.328936476s) [upload=8844]: Upload finished. err: <nil> Aug 7 18:09:08.962290352 (8h29m8.551635339s) [upload=8862]: Starting upload Aug 7 18:09:08.962325299 (8h29m8.551670286s) [upload=8862]: Done starting upload Aug 7 18:09:08.962367259 (8h29m8.551712246s) [upload=8862]: Uploading segments... Aug 7 18:09:08.962397838 (8h29m8.551742825s) [upload=8862]: Got next segment. Inline: true Aug 7 18:09:08.962401585 (8h29m8.551746572s) [upload=8862]: Waiting for error group managing segments... Aug 7 18:09:08.962444857 (8h29m8.551789844s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:08.962449055 (8h29m8.551794042s) [upload=8862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:08.962451691 (8h29m8.551796678s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:09.256530018 (8h29m8.845875005s) [upload=8862]: Done uploading segments... Aug 7 18:09:09.256598799 (8h29m8.845943796s) [upload=8862]: Upload finished. err: <nil> Aug 7 18:09:53.903185086 (8h29m53.492530073s) [upload=8874]: Starting upload Aug 7 18:09:53.903229430 (8h29m53.492574417s) [upload=8874]: Done starting upload Aug 7 18:09:53.903289726 (8h29m53.492634714s) [upload=8874]: Uploading segments... Aug 7 18:09:53.903323862 (8h29m53.492668849s) [upload=8874]: Got next segment. Inline: true Aug 7 18:09:53.903327488 (8h29m53.492672465s) [upload=8874]: Waiting for error group managing segments... Aug 7 18:09:53.903359990 (8h29m53.492704977s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:53.903363988 (8h29m53.492708975s) [upload=8874]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:53.903366563 (8h29m53.49271154s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:54.205270072 (8h29m53.794615059s) [upload=8874]: Done uploading segments... Aug 7 18:09:54.205287746 (8h29m53.794632733s) [upload=8874]: Upload finished. err: <nil> Duration: 1.992089787s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....................XXX.......X..X..........................] duration: 5.855490338s FAIL (2025-08-07 18:22:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 5.855519154s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....................XXX.......X..X.........................] duration: 6.047499237s FAIL (2025-08-07 18:21:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 6.047523714s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......................XXX.......X..X........................] duration: 6.338753412s FAIL (2025-08-07 18:21:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 6.338779553s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X..........X....X...............] duration: 1.88656224s FAIL (2025-08-07 18:21:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== pb.BatchRequestItem_SegmentMakeInline Aug 7 18:02:58.324202419 (8h22m57.913547406s) [upload=8751]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:02:58.698491093 (8h22m58.28783608s) [upload=8751]: Done uploading segments... Aug 7 18:02:58.698512194 (8h22m58.287857181s) [upload=8751]: Upload finished. err: <nil> Aug 7 18:03:34.023713956 (8h23m33.613058943s) [upload=8762]: Starting upload Aug 7 18:03:34.023756718 (8h23m33.613101705s) [upload=8762]: Done starting upload Aug 7 18:03:34.023810802 (8h23m33.613155789s) [upload=8762]: Uploading segments... Aug 7 18:03:34.023849966 (8h23m33.613194953s) [upload=8762]: Got next segment. Inline: true Aug 7 18:03:34.023854666 (8h23m33.613199653s) [upload=8762]: Waiting for error group managing segments... Aug 7 18:03:34.023897628 (8h23m33.613242615s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:34.023901234 (8h23m33.613246211s) [upload=8762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:34.023903569 (8h23m33.613248556s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:34.301041444 (8h23m33.890386431s) [upload=8762]: Done uploading segments... Aug 7 18:03:34.301059288 (8h23m33.890404275s) [upload=8762]: Upload finished. err: <nil> Aug 7 18:03:59.853483337 (8h23m59.442828324s) [upload=8770]: Starting upload Aug 7 18:03:59.853529155 (8h23m59.442874142s) [upload=8770]: Done starting upload Aug 7 18:03:59.853588008 (8h23m59.442932995s) [upload=8770]: Uploading segments... Aug 7 18:03:59.853685885 (8h23m59.443030902s) [upload=8770]: Got next segment. Inline: true Aug 7 18:03:59.853694351 (8h23m59.443039338s) [upload=8770]: Waiting for error group managing segments... Aug 7 18:03:59.853789563 (8h23m59.44313455s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:59.853811105 (8h23m59.443156092s) [upload=8770]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:59.853813669 (8h23m59.443158656s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:04:00.248702898 (8h23m59.838047905s) [upload=8770]: Done uploading segments... Aug 7 18:04:00.248729179 (8h23m59.838074166s) [upload=8770]: Upload finished. err: <nil> Aug 7 18:05:11.288723553 (8h25m10.87806854s) [upload=8792]: Starting upload Aug 7 18:05:11.288768570 (8h25m10.878113557s) [upload=8792]: Done starting upload Aug 7 18:05:11.288821371 (8h25m10.878166358s) [upload=8792]: Uploading segments... Aug 7 18:05:11.288853282 (8h25m10.878198269s) [upload=8792]: Got next segment. Inline: true Aug 7 18:05:11.288856989 (8h25m10.878201976s) [upload=8792]: Waiting for error group managing segments... Aug 7 18:05:11.288889871 (8h25m10.878234858s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:11.288894972 (8h25m10.878239969s) [upload=8792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:11.288897246 (8h25m10.878242233s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:11.633494661 (8h25m11.222839648s) [upload=8792]: Done uploading segments... Aug 7 18:05:11.633511834 (8h25m11.222856821s) [upload=8792]: Upload finished. err: <nil> Aug 7 18:05:46.281330062 (8h25m45.870675059s) [upload=8802]: Starting upload Aug 7 18:05:46.281387371 (8h25m45.870732358s) [upload=8802]: Done starting upload Aug 7 18:05:46.281445092 (8h25m45.870790079s) [upload=8802]: Uploading segments... Aug 7 18:05:46.281475491 (8h25m45.870820478s) [upload=8802]: Got next segment. Inline: true Aug 7 18:05:46.281479218 (8h25m45.870824205s) [upload=8802]: Waiting for error group managing segments... Aug 7 18:05:46.281513543 (8h25m45.87085853s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:46.281517781 (8h25m45.870862768s) [upload=8802]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:46.281520146 (8h25m45.870865133s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:46.556872305 (8h25m46.146217292s) [upload=8802]: Done uploading segments... Aug 7 18:05:46.556891452 (8h25m46.146236439s) [upload=8802]: Upload finished. err: <nil> Aug 7 18:06:26.963610183 (8h26m26.55295517s) [upload=8814]: Starting upload Aug 7 18:06:26.963657103 (8h26m26.55300209s) [upload=8814]: Done starting upload Aug 7 18:06:26.963737527 (8h26m26.553082514s) [upload=8814]: Uploading segments... Aug 7 18:06:26.963867786 (8h26m26.553212783s) [upload=8814]: Got next segment. Inline: true Aug 7 18:06:26.963874910 (8h26m26.553219897s) [upload=8814]: Waiting for error group managing segments... Aug 7 18:06:26.963927700 (8h26m26.553272687s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:26.963934554 (8h26m26.553279541s) [upload=8814]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:26.963937970 (8h26m26.553282957s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:27.258606837 (8h26m26.847951824s) [upload=8814]: Done uploading segments... Aug 7 18:06:27.258625452 (8h26m26.84797044s) [upload=8814]: Upload finished. err: <nil> Aug 7 18:06:58.759713181 (8h26m58.349058158s) [upload=8824]: Starting upload Aug 7 18:06:58.759765702 (8h26m58.349110689s) [upload=8824]: Done starting upload Aug 7 18:06:58.759814064 (8h26m58.349159052s) [upload=8824]: Uploading segments... Aug 7 18:06:58.759845304 (8h26m58.349190291s) [upload=8824]: Got next segment. Inline: true Aug 7 18:06:58.759849382 (8h26m58.349194369s) [upload=8824]: Waiting for error group managing segments... Aug 7 18:06:58.759883998 (8h26m58.349228985s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:58.759888256 (8h26m58.349233243s) [upload=8824]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:58.759892514 (8h26m58.349237501s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:59.029430588 (8h26m58.618775575s) [upload=8824]: Done uploading segments... Aug 7 18:06:59.029447962 (8h26m58.618792949s) [upload=8824]: Upload finished. err: <nil> Aug 7 18:07:21.849459220 (8h27m21.438804207s) [upload=8832]: Starting upload Aug 7 18:07:21.849502753 (8h27m21.43884774s) [upload=8832]: Done starting upload Aug 7 18:07:21.849555023 (8h27m21.43890001s) [upload=8832]: Uploading segments... Aug 7 18:07:21.849584629 (8h27m21.438929606s) [upload=8832]: Got next segment. Inline: true Aug 7 18:07:21.849588207 (8h27m21.438933194s) [upload=8832]: Waiting for error group managing segments... Aug 7 18:07:21.849642782 (8h27m21.438987769s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:07:21.849646969 (8h27m21.438991946s) [upload=8832]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:07:21.849649234 (8h27m21.438994221s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:07:22.125155216 (8h27m21.714500193s) [upload=8832]: Done uploading segments... Aug 7 18:07:22.125168983 (8h27m21.71451397s) [upload=8832]: Upload finished. err: <nil> Aug 7 18:08:04.258700436 (8h28m3.848045423s) [upload=8844]: Starting upload Aug 7 18:08:04.258764518 (8h28m3.848109505s) [upload=8844]: Done starting upload Aug 7 18:08:04.258817950 (8h28m3.848162937s) [upload=8844]: Uploading segments... Aug 7 18:08:04.258851825 (8h28m3.848196812s) [upload=8844]: Got next segment. Inline: true Aug 7 18:08:04.258856134 (8h28m3.848201121s) [upload=8844]: Waiting for error group managing segments... Aug 7 18:08:04.258889087 (8h28m3.848234074s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:08:04.258893615 (8h28m3.848238602s) [upload=8844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:08:04.258896881 (8h28m3.848241868s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:08:04.739572923 (8h28m4.32891791s) [upload=8844]: Done uploading segments... Aug 7 18:08:04.739591489 (8h28m4.328936476s) [upload=8844]: Upload finished. err: <nil> Aug 7 18:09:08.962290352 (8h29m8.551635339s) [upload=8862]: Starting upload Aug 7 18:09:08.962325299 (8h29m8.551670286s) [upload=8862]: Done starting upload Aug 7 18:09:08.962367259 (8h29m8.551712246s) [upload=8862]: Uploading segments... Aug 7 18:09:08.962397838 (8h29m8.551742825s) [upload=8862]: Got next segment. Inline: true Aug 7 18:09:08.962401585 (8h29m8.551746572s) [upload=8862]: Waiting for error group managing segments... Aug 7 18:09:08.962444857 (8h29m8.551789844s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:08.962449055 (8h29m8.551794042s) [upload=8862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:08.962451691 (8h29m8.551796678s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:09.256530018 (8h29m8.845875005s) [upload=8862]: Done uploading segments... Aug 7 18:09:09.256598799 (8h29m8.845943796s) [upload=8862]: Upload finished. err: <nil> Aug 7 18:09:53.903185086 (8h29m53.492530073s) [upload=8874]: Starting upload Aug 7 18:09:53.903229430 (8h29m53.492574417s) [upload=8874]: Done starting upload Aug 7 18:09:53.903289726 (8h29m53.492634714s) [upload=8874]: Uploading segments... Aug 7 18:09:53.903323862 (8h29m53.492668849s) [upload=8874]: Got next segment. Inline: true Aug 7 18:09:53.903327488 (8h29m53.492672465s) [upload=8874]: Waiting for error group managing segments... Aug 7 18:09:53.903359990 (8h29m53.492704977s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:53.903363988 (8h29m53.492708975s) [upload=8874]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:53.903366563 (8h29m53.49271154s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:54.205270072 (8h29m53.794615059s) [upload=8874]: Done uploading segments... Aug 7 18:09:54.205287746 (8h29m53.794632733s) [upload=8874]: Upload finished. err: <nil> Duration: 1.886592287s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................X..........X....X..............] duration: 1.844873758s FAIL (2025-08-07 18:20:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== pb.BatchRequestItem_SegmentMakeInline Aug 7 18:02:58.324202419 (8h22m57.913547406s) [upload=8751]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:02:58.698491093 (8h22m58.28783608s) [upload=8751]: Done uploading segments... Aug 7 18:02:58.698512194 (8h22m58.287857181s) [upload=8751]: Upload finished. err: <nil> Aug 7 18:03:34.023713956 (8h23m33.613058943s) [upload=8762]: Starting upload Aug 7 18:03:34.023756718 (8h23m33.613101705s) [upload=8762]: Done starting upload Aug 7 18:03:34.023810802 (8h23m33.613155789s) [upload=8762]: Uploading segments... Aug 7 18:03:34.023849966 (8h23m33.613194953s) [upload=8762]: Got next segment. Inline: true Aug 7 18:03:34.023854666 (8h23m33.613199653s) [upload=8762]: Waiting for error group managing segments... Aug 7 18:03:34.023897628 (8h23m33.613242615s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:34.023901234 (8h23m33.613246211s) [upload=8762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:34.023903569 (8h23m33.613248556s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:34.301041444 (8h23m33.890386431s) [upload=8762]: Done uploading segments... Aug 7 18:03:34.301059288 (8h23m33.890404275s) [upload=8762]: Upload finished. err: <nil> Aug 7 18:03:59.853483337 (8h23m59.442828324s) [upload=8770]: Starting upload Aug 7 18:03:59.853529155 (8h23m59.442874142s) [upload=8770]: Done starting upload Aug 7 18:03:59.853588008 (8h23m59.442932995s) [upload=8770]: Uploading segments... Aug 7 18:03:59.853685885 (8h23m59.443030902s) [upload=8770]: Got next segment. Inline: true Aug 7 18:03:59.853694351 (8h23m59.443039338s) [upload=8770]: Waiting for error group managing segments... Aug 7 18:03:59.853789563 (8h23m59.44313455s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:59.853811105 (8h23m59.443156092s) [upload=8770]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:59.853813669 (8h23m59.443158656s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:04:00.248702898 (8h23m59.838047905s) [upload=8770]: Done uploading segments... Aug 7 18:04:00.248729179 (8h23m59.838074166s) [upload=8770]: Upload finished. err: <nil> Aug 7 18:05:11.288723553 (8h25m10.87806854s) [upload=8792]: Starting upload Aug 7 18:05:11.288768570 (8h25m10.878113557s) [upload=8792]: Done starting upload Aug 7 18:05:11.288821371 (8h25m10.878166358s) [upload=8792]: Uploading segments... Aug 7 18:05:11.288853282 (8h25m10.878198269s) [upload=8792]: Got next segment. Inline: true Aug 7 18:05:11.288856989 (8h25m10.878201976s) [upload=8792]: Waiting for error group managing segments... Aug 7 18:05:11.288889871 (8h25m10.878234858s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:11.288894972 (8h25m10.878239969s) [upload=8792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:11.288897246 (8h25m10.878242233s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:11.633494661 (8h25m11.222839648s) [upload=8792]: Done uploading segments... Aug 7 18:05:11.633511834 (8h25m11.222856821s) [upload=8792]: Upload finished. err: <nil> Aug 7 18:05:46.281330062 (8h25m45.870675059s) [upload=8802]: Starting upload Aug 7 18:05:46.281387371 (8h25m45.870732358s) [upload=8802]: Done starting upload Aug 7 18:05:46.281445092 (8h25m45.870790079s) [upload=8802]: Uploading segments... Aug 7 18:05:46.281475491 (8h25m45.870820478s) [upload=8802]: Got next segment. Inline: true Aug 7 18:05:46.281479218 (8h25m45.870824205s) [upload=8802]: Waiting for error group managing segments... Aug 7 18:05:46.281513543 (8h25m45.87085853s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:46.281517781 (8h25m45.870862768s) [upload=8802]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:46.281520146 (8h25m45.870865133s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:46.556872305 (8h25m46.146217292s) [upload=8802]: Done uploading segments... Aug 7 18:05:46.556891452 (8h25m46.146236439s) [upload=8802]: Upload finished. err: <nil> Aug 7 18:06:26.963610183 (8h26m26.55295517s) [upload=8814]: Starting upload Aug 7 18:06:26.963657103 (8h26m26.55300209s) [upload=8814]: Done starting upload Aug 7 18:06:26.963737527 (8h26m26.553082514s) [upload=8814]: Uploading segments... Aug 7 18:06:26.963867786 (8h26m26.553212783s) [upload=8814]: Got next segment. Inline: true Aug 7 18:06:26.963874910 (8h26m26.553219897s) [upload=8814]: Waiting for error group managing segments... Aug 7 18:06:26.963927700 (8h26m26.553272687s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:26.963934554 (8h26m26.553279541s) [upload=8814]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:26.963937970 (8h26m26.553282957s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:27.258606837 (8h26m26.847951824s) [upload=8814]: Done uploading segments... Aug 7 18:06:27.258625452 (8h26m26.84797044s) [upload=8814]: Upload finished. err: <nil> Aug 7 18:06:58.759713181 (8h26m58.349058158s) [upload=8824]: Starting upload Aug 7 18:06:58.759765702 (8h26m58.349110689s) [upload=8824]: Done starting upload Aug 7 18:06:58.759814064 (8h26m58.349159052s) [upload=8824]: Uploading segments... Aug 7 18:06:58.759845304 (8h26m58.349190291s) [upload=8824]: Got next segment. Inline: true Aug 7 18:06:58.759849382 (8h26m58.349194369s) [upload=8824]: Waiting for error group managing segments... Aug 7 18:06:58.759883998 (8h26m58.349228985s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:58.759888256 (8h26m58.349233243s) [upload=8824]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:58.759892514 (8h26m58.349237501s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:59.029430588 (8h26m58.618775575s) [upload=8824]: Done uploading segments... Aug 7 18:06:59.029447962 (8h26m58.618792949s) [upload=8824]: Upload finished. err: <nil> Aug 7 18:07:21.849459220 (8h27m21.438804207s) [upload=8832]: Starting upload Aug 7 18:07:21.849502753 (8h27m21.43884774s) [upload=8832]: Done starting upload Aug 7 18:07:21.849555023 (8h27m21.43890001s) [upload=8832]: Uploading segments... Aug 7 18:07:21.849584629 (8h27m21.438929606s) [upload=8832]: Got next segment. Inline: true Aug 7 18:07:21.849588207 (8h27m21.438933194s) [upload=8832]: Waiting for error group managing segments... Aug 7 18:07:21.849642782 (8h27m21.438987769s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:07:21.849646969 (8h27m21.438991946s) [upload=8832]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:07:21.849649234 (8h27m21.438994221s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:07:22.125155216 (8h27m21.714500193s) [upload=8832]: Done uploading segments... Aug 7 18:07:22.125168983 (8h27m21.71451397s) [upload=8832]: Upload finished. err: <nil> Aug 7 18:08:04.258700436 (8h28m3.848045423s) [upload=8844]: Starting upload Aug 7 18:08:04.258764518 (8h28m3.848109505s) [upload=8844]: Done starting upload Aug 7 18:08:04.258817950 (8h28m3.848162937s) [upload=8844]: Uploading segments... Aug 7 18:08:04.258851825 (8h28m3.848196812s) [upload=8844]: Got next segment. Inline: true Aug 7 18:08:04.258856134 (8h28m3.848201121s) [upload=8844]: Waiting for error group managing segments... Aug 7 18:08:04.258889087 (8h28m3.848234074s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:08:04.258893615 (8h28m3.848238602s) [upload=8844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:08:04.258896881 (8h28m3.848241868s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:08:04.739572923 (8h28m4.32891791s) [upload=8844]: Done uploading segments... Aug 7 18:08:04.739591489 (8h28m4.328936476s) [upload=8844]: Upload finished. err: <nil> Aug 7 18:09:08.962290352 (8h29m8.551635339s) [upload=8862]: Starting upload Aug 7 18:09:08.962325299 (8h29m8.551670286s) [upload=8862]: Done starting upload Aug 7 18:09:08.962367259 (8h29m8.551712246s) [upload=8862]: Uploading segments... Aug 7 18:09:08.962397838 (8h29m8.551742825s) [upload=8862]: Got next segment. Inline: true Aug 7 18:09:08.962401585 (8h29m8.551746572s) [upload=8862]: Waiting for error group managing segments... Aug 7 18:09:08.962444857 (8h29m8.551789844s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:08.962449055 (8h29m8.551794042s) [upload=8862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:08.962451691 (8h29m8.551796678s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:09.256530018 (8h29m8.845875005s) [upload=8862]: Done uploading segments... Aug 7 18:09:09.256598799 (8h29m8.845943796s) [upload=8862]: Upload finished. err: <nil> Aug 7 18:09:53.903185086 (8h29m53.492530073s) [upload=8874]: Starting upload Aug 7 18:09:53.903229430 (8h29m53.492574417s) [upload=8874]: Done starting upload Aug 7 18:09:53.903289726 (8h29m53.492634714s) [upload=8874]: Uploading segments... Aug 7 18:09:53.903323862 (8h29m53.492668849s) [upload=8874]: Got next segment. Inline: true Aug 7 18:09:53.903327488 (8h29m53.492672465s) [upload=8874]: Waiting for error group managing segments... Aug 7 18:09:53.903359990 (8h29m53.492704977s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:53.903363988 (8h29m53.492708975s) [upload=8874]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:53.903366563 (8h29m53.49271154s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:54.205270072 (8h29m53.794615059s) [upload=8874]: Done uploading segments... Aug 7 18:09:54.205287746 (8h29m53.794632733s) [upload=8874]: Upload finished. err: <nil> Duration: 1.844900479s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......................XXX.......X..X.......................] duration: 6.006719366s FAIL (2025-08-07 18:20:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 6.006746507s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X..........X....X.............] duration: 1.943027716s FAIL (2025-08-07 18:19:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== pb.BatchRequestItem_SegmentMakeInline Aug 7 18:02:58.324202419 (8h22m57.913547406s) [upload=8751]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:02:58.698491093 (8h22m58.28783608s) [upload=8751]: Done uploading segments... Aug 7 18:02:58.698512194 (8h22m58.287857181s) [upload=8751]: Upload finished. err: <nil> Aug 7 18:03:34.023713956 (8h23m33.613058943s) [upload=8762]: Starting upload Aug 7 18:03:34.023756718 (8h23m33.613101705s) [upload=8762]: Done starting upload Aug 7 18:03:34.023810802 (8h23m33.613155789s) [upload=8762]: Uploading segments... Aug 7 18:03:34.023849966 (8h23m33.613194953s) [upload=8762]: Got next segment. Inline: true Aug 7 18:03:34.023854666 (8h23m33.613199653s) [upload=8762]: Waiting for error group managing segments... Aug 7 18:03:34.023897628 (8h23m33.613242615s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:34.023901234 (8h23m33.613246211s) [upload=8762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:34.023903569 (8h23m33.613248556s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:34.301041444 (8h23m33.890386431s) [upload=8762]: Done uploading segments... Aug 7 18:03:34.301059288 (8h23m33.890404275s) [upload=8762]: Upload finished. err: <nil> Aug 7 18:03:59.853483337 (8h23m59.442828324s) [upload=8770]: Starting upload Aug 7 18:03:59.853529155 (8h23m59.442874142s) [upload=8770]: Done starting upload Aug 7 18:03:59.853588008 (8h23m59.442932995s) [upload=8770]: Uploading segments... Aug 7 18:03:59.853685885 (8h23m59.443030902s) [upload=8770]: Got next segment. Inline: true Aug 7 18:03:59.853694351 (8h23m59.443039338s) [upload=8770]: Waiting for error group managing segments... Aug 7 18:03:59.853789563 (8h23m59.44313455s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:59.853811105 (8h23m59.443156092s) [upload=8770]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:59.853813669 (8h23m59.443158656s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:04:00.248702898 (8h23m59.838047905s) [upload=8770]: Done uploading segments... Aug 7 18:04:00.248729179 (8h23m59.838074166s) [upload=8770]: Upload finished. err: <nil> Aug 7 18:05:11.288723553 (8h25m10.87806854s) [upload=8792]: Starting upload Aug 7 18:05:11.288768570 (8h25m10.878113557s) [upload=8792]: Done starting upload Aug 7 18:05:11.288821371 (8h25m10.878166358s) [upload=8792]: Uploading segments... Aug 7 18:05:11.288853282 (8h25m10.878198269s) [upload=8792]: Got next segment. Inline: true Aug 7 18:05:11.288856989 (8h25m10.878201976s) [upload=8792]: Waiting for error group managing segments... Aug 7 18:05:11.288889871 (8h25m10.878234858s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:11.288894972 (8h25m10.878239969s) [upload=8792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:11.288897246 (8h25m10.878242233s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:11.633494661 (8h25m11.222839648s) [upload=8792]: Done uploading segments... Aug 7 18:05:11.633511834 (8h25m11.222856821s) [upload=8792]: Upload finished. err: <nil> Aug 7 18:05:46.281330062 (8h25m45.870675059s) [upload=8802]: Starting upload Aug 7 18:05:46.281387371 (8h25m45.870732358s) [upload=8802]: Done starting upload Aug 7 18:05:46.281445092 (8h25m45.870790079s) [upload=8802]: Uploading segments... Aug 7 18:05:46.281475491 (8h25m45.870820478s) [upload=8802]: Got next segment. Inline: true Aug 7 18:05:46.281479218 (8h25m45.870824205s) [upload=8802]: Waiting for error group managing segments... Aug 7 18:05:46.281513543 (8h25m45.87085853s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:46.281517781 (8h25m45.870862768s) [upload=8802]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:46.281520146 (8h25m45.870865133s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:46.556872305 (8h25m46.146217292s) [upload=8802]: Done uploading segments... Aug 7 18:05:46.556891452 (8h25m46.146236439s) [upload=8802]: Upload finished. err: <nil> Aug 7 18:06:26.963610183 (8h26m26.55295517s) [upload=8814]: Starting upload Aug 7 18:06:26.963657103 (8h26m26.55300209s) [upload=8814]: Done starting upload Aug 7 18:06:26.963737527 (8h26m26.553082514s) [upload=8814]: Uploading segments... Aug 7 18:06:26.963867786 (8h26m26.553212783s) [upload=8814]: Got next segment. Inline: true Aug 7 18:06:26.963874910 (8h26m26.553219897s) [upload=8814]: Waiting for error group managing segments... Aug 7 18:06:26.963927700 (8h26m26.553272687s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:26.963934554 (8h26m26.553279541s) [upload=8814]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:26.963937970 (8h26m26.553282957s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:27.258606837 (8h26m26.847951824s) [upload=8814]: Done uploading segments... Aug 7 18:06:27.258625452 (8h26m26.84797044s) [upload=8814]: Upload finished. err: <nil> Aug 7 18:06:58.759713181 (8h26m58.349058158s) [upload=8824]: Starting upload Aug 7 18:06:58.759765702 (8h26m58.349110689s) [upload=8824]: Done starting upload Aug 7 18:06:58.759814064 (8h26m58.349159052s) [upload=8824]: Uploading segments... Aug 7 18:06:58.759845304 (8h26m58.349190291s) [upload=8824]: Got next segment. Inline: true Aug 7 18:06:58.759849382 (8h26m58.349194369s) [upload=8824]: Waiting for error group managing segments... Aug 7 18:06:58.759883998 (8h26m58.349228985s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:58.759888256 (8h26m58.349233243s) [upload=8824]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:58.759892514 (8h26m58.349237501s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:59.029430588 (8h26m58.618775575s) [upload=8824]: Done uploading segments... Aug 7 18:06:59.029447962 (8h26m58.618792949s) [upload=8824]: Upload finished. err: <nil> Aug 7 18:07:21.849459220 (8h27m21.438804207s) [upload=8832]: Starting upload Aug 7 18:07:21.849502753 (8h27m21.43884774s) [upload=8832]: Done starting upload Aug 7 18:07:21.849555023 (8h27m21.43890001s) [upload=8832]: Uploading segments... Aug 7 18:07:21.849584629 (8h27m21.438929606s) [upload=8832]: Got next segment. Inline: true Aug 7 18:07:21.849588207 (8h27m21.438933194s) [upload=8832]: Waiting for error group managing segments... Aug 7 18:07:21.849642782 (8h27m21.438987769s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:07:21.849646969 (8h27m21.438991946s) [upload=8832]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:07:21.849649234 (8h27m21.438994221s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:07:22.125155216 (8h27m21.714500193s) [upload=8832]: Done uploading segments... Aug 7 18:07:22.125168983 (8h27m21.71451397s) [upload=8832]: Upload finished. err: <nil> Aug 7 18:08:04.258700436 (8h28m3.848045423s) [upload=8844]: Starting upload Aug 7 18:08:04.258764518 (8h28m3.848109505s) [upload=8844]: Done starting upload Aug 7 18:08:04.258817950 (8h28m3.848162937s) [upload=8844]: Uploading segments... Aug 7 18:08:04.258851825 (8h28m3.848196812s) [upload=8844]: Got next segment. Inline: true Aug 7 18:08:04.258856134 (8h28m3.848201121s) [upload=8844]: Waiting for error group managing segments... Aug 7 18:08:04.258889087 (8h28m3.848234074s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:08:04.258893615 (8h28m3.848238602s) [upload=8844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:08:04.258896881 (8h28m3.848241868s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:08:04.739572923 (8h28m4.32891791s) [upload=8844]: Done uploading segments... Aug 7 18:08:04.739591489 (8h28m4.328936476s) [upload=8844]: Upload finished. err: <nil> Aug 7 18:09:08.962290352 (8h29m8.551635339s) [upload=8862]: Starting upload Aug 7 18:09:08.962325299 (8h29m8.551670286s) [upload=8862]: Done starting upload Aug 7 18:09:08.962367259 (8h29m8.551712246s) [upload=8862]: Uploading segments... Aug 7 18:09:08.962397838 (8h29m8.551742825s) [upload=8862]: Got next segment. Inline: true Aug 7 18:09:08.962401585 (8h29m8.551746572s) [upload=8862]: Waiting for error group managing segments... Aug 7 18:09:08.962444857 (8h29m8.551789844s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:08.962449055 (8h29m8.551794042s) [upload=8862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:08.962451691 (8h29m8.551796678s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:09.256530018 (8h29m8.845875005s) [upload=8862]: Done uploading segments... Aug 7 18:09:09.256598799 (8h29m8.845943796s) [upload=8862]: Upload finished. err: <nil> Aug 7 18:09:53.903185086 (8h29m53.492530073s) [upload=8874]: Starting upload Aug 7 18:09:53.903229430 (8h29m53.492574417s) [upload=8874]: Done starting upload Aug 7 18:09:53.903289726 (8h29m53.492634714s) [upload=8874]: Uploading segments... Aug 7 18:09:53.903323862 (8h29m53.492668849s) [upload=8874]: Got next segment. Inline: true Aug 7 18:09:53.903327488 (8h29m53.492672465s) [upload=8874]: Waiting for error group managing segments... Aug 7 18:09:53.903359990 (8h29m53.492704977s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:53.903363988 (8h29m53.492708975s) [upload=8874]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:53.903366563 (8h29m53.49271154s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:54.205270072 (8h29m53.794615059s) [upload=8874]: Done uploading segments... Aug 7 18:09:54.205287746 (8h29m53.794632733s) [upload=8874]: Upload finished. err: <nil> Duration: 1.943056521s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........................XXX.......X..X......................] duration: 6.106211953s FAIL (2025-08-07 18:19:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 6.106238725s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X..........X....X............] duration: 2.225897316s FAIL (2025-08-07 18:19:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== pb.BatchRequestItem_SegmentMakeInline Aug 7 18:02:58.324202419 (8h22m57.913547406s) [upload=8751]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:02:58.698491093 (8h22m58.28783608s) [upload=8751]: Done uploading segments... Aug 7 18:02:58.698512194 (8h22m58.287857181s) [upload=8751]: Upload finished. err: <nil> Aug 7 18:03:34.023713956 (8h23m33.613058943s) [upload=8762]: Starting upload Aug 7 18:03:34.023756718 (8h23m33.613101705s) [upload=8762]: Done starting upload Aug 7 18:03:34.023810802 (8h23m33.613155789s) [upload=8762]: Uploading segments... Aug 7 18:03:34.023849966 (8h23m33.613194953s) [upload=8762]: Got next segment. Inline: true Aug 7 18:03:34.023854666 (8h23m33.613199653s) [upload=8762]: Waiting for error group managing segments... Aug 7 18:03:34.023897628 (8h23m33.613242615s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:34.023901234 (8h23m33.613246211s) [upload=8762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:34.023903569 (8h23m33.613248556s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:34.301041444 (8h23m33.890386431s) [upload=8762]: Done uploading segments... Aug 7 18:03:34.301059288 (8h23m33.890404275s) [upload=8762]: Upload finished. err: <nil> Aug 7 18:03:59.853483337 (8h23m59.442828324s) [upload=8770]: Starting upload Aug 7 18:03:59.853529155 (8h23m59.442874142s) [upload=8770]: Done starting upload Aug 7 18:03:59.853588008 (8h23m59.442932995s) [upload=8770]: Uploading segments... Aug 7 18:03:59.853685885 (8h23m59.443030902s) [upload=8770]: Got next segment. Inline: true Aug 7 18:03:59.853694351 (8h23m59.443039338s) [upload=8770]: Waiting for error group managing segments... Aug 7 18:03:59.853789563 (8h23m59.44313455s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:59.853811105 (8h23m59.443156092s) [upload=8770]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:59.853813669 (8h23m59.443158656s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:04:00.248702898 (8h23m59.838047905s) [upload=8770]: Done uploading segments... Aug 7 18:04:00.248729179 (8h23m59.838074166s) [upload=8770]: Upload finished. err: <nil> Aug 7 18:05:11.288723553 (8h25m10.87806854s) [upload=8792]: Starting upload Aug 7 18:05:11.288768570 (8h25m10.878113557s) [upload=8792]: Done starting upload Aug 7 18:05:11.288821371 (8h25m10.878166358s) [upload=8792]: Uploading segments... Aug 7 18:05:11.288853282 (8h25m10.878198269s) [upload=8792]: Got next segment. Inline: true Aug 7 18:05:11.288856989 (8h25m10.878201976s) [upload=8792]: Waiting for error group managing segments... Aug 7 18:05:11.288889871 (8h25m10.878234858s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:11.288894972 (8h25m10.878239969s) [upload=8792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:11.288897246 (8h25m10.878242233s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:11.633494661 (8h25m11.222839648s) [upload=8792]: Done uploading segments... Aug 7 18:05:11.633511834 (8h25m11.222856821s) [upload=8792]: Upload finished. err: <nil> Aug 7 18:05:46.281330062 (8h25m45.870675059s) [upload=8802]: Starting upload Aug 7 18:05:46.281387371 (8h25m45.870732358s) [upload=8802]: Done starting upload Aug 7 18:05:46.281445092 (8h25m45.870790079s) [upload=8802]: Uploading segments... Aug 7 18:05:46.281475491 (8h25m45.870820478s) [upload=8802]: Got next segment. Inline: true Aug 7 18:05:46.281479218 (8h25m45.870824205s) [upload=8802]: Waiting for error group managing segments... Aug 7 18:05:46.281513543 (8h25m45.87085853s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:46.281517781 (8h25m45.870862768s) [upload=8802]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:46.281520146 (8h25m45.870865133s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:46.556872305 (8h25m46.146217292s) [upload=8802]: Done uploading segments... Aug 7 18:05:46.556891452 (8h25m46.146236439s) [upload=8802]: Upload finished. err: <nil> Aug 7 18:06:26.963610183 (8h26m26.55295517s) [upload=8814]: Starting upload Aug 7 18:06:26.963657103 (8h26m26.55300209s) [upload=8814]: Done starting upload Aug 7 18:06:26.963737527 (8h26m26.553082514s) [upload=8814]: Uploading segments... Aug 7 18:06:26.963867786 (8h26m26.553212783s) [upload=8814]: Got next segment. Inline: true Aug 7 18:06:26.963874910 (8h26m26.553219897s) [upload=8814]: Waiting for error group managing segments... Aug 7 18:06:26.963927700 (8h26m26.553272687s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:26.963934554 (8h26m26.553279541s) [upload=8814]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:26.963937970 (8h26m26.553282957s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:27.258606837 (8h26m26.847951824s) [upload=8814]: Done uploading segments... Aug 7 18:06:27.258625452 (8h26m26.84797044s) [upload=8814]: Upload finished. err: <nil> Aug 7 18:06:58.759713181 (8h26m58.349058158s) [upload=8824]: Starting upload Aug 7 18:06:58.759765702 (8h26m58.349110689s) [upload=8824]: Done starting upload Aug 7 18:06:58.759814064 (8h26m58.349159052s) [upload=8824]: Uploading segments... Aug 7 18:06:58.759845304 (8h26m58.349190291s) [upload=8824]: Got next segment. Inline: true Aug 7 18:06:58.759849382 (8h26m58.349194369s) [upload=8824]: Waiting for error group managing segments... Aug 7 18:06:58.759883998 (8h26m58.349228985s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:58.759888256 (8h26m58.349233243s) [upload=8824]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:58.759892514 (8h26m58.349237501s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:59.029430588 (8h26m58.618775575s) [upload=8824]: Done uploading segments... Aug 7 18:06:59.029447962 (8h26m58.618792949s) [upload=8824]: Upload finished. err: <nil> Aug 7 18:07:21.849459220 (8h27m21.438804207s) [upload=8832]: Starting upload Aug 7 18:07:21.849502753 (8h27m21.43884774s) [upload=8832]: Done starting upload Aug 7 18:07:21.849555023 (8h27m21.43890001s) [upload=8832]: Uploading segments... Aug 7 18:07:21.849584629 (8h27m21.438929606s) [upload=8832]: Got next segment. Inline: true Aug 7 18:07:21.849588207 (8h27m21.438933194s) [upload=8832]: Waiting for error group managing segments... Aug 7 18:07:21.849642782 (8h27m21.438987769s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:07:21.849646969 (8h27m21.438991946s) [upload=8832]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:07:21.849649234 (8h27m21.438994221s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:07:22.125155216 (8h27m21.714500193s) [upload=8832]: Done uploading segments... Aug 7 18:07:22.125168983 (8h27m21.71451397s) [upload=8832]: Upload finished. err: <nil> Aug 7 18:08:04.258700436 (8h28m3.848045423s) [upload=8844]: Starting upload Aug 7 18:08:04.258764518 (8h28m3.848109505s) [upload=8844]: Done starting upload Aug 7 18:08:04.258817950 (8h28m3.848162937s) [upload=8844]: Uploading segments... Aug 7 18:08:04.258851825 (8h28m3.848196812s) [upload=8844]: Got next segment. Inline: true Aug 7 18:08:04.258856134 (8h28m3.848201121s) [upload=8844]: Waiting for error group managing segments... Aug 7 18:08:04.258889087 (8h28m3.848234074s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:08:04.258893615 (8h28m3.848238602s) [upload=8844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:08:04.258896881 (8h28m3.848241868s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:08:04.739572923 (8h28m4.32891791s) [upload=8844]: Done uploading segments... Aug 7 18:08:04.739591489 (8h28m4.328936476s) [upload=8844]: Upload finished. err: <nil> Aug 7 18:09:08.962290352 (8h29m8.551635339s) [upload=8862]: Starting upload Aug 7 18:09:08.962325299 (8h29m8.551670286s) [upload=8862]: Done starting upload Aug 7 18:09:08.962367259 (8h29m8.551712246s) [upload=8862]: Uploading segments... Aug 7 18:09:08.962397838 (8h29m8.551742825s) [upload=8862]: Got next segment. Inline: true Aug 7 18:09:08.962401585 (8h29m8.551746572s) [upload=8862]: Waiting for error group managing segments... Aug 7 18:09:08.962444857 (8h29m8.551789844s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:08.962449055 (8h29m8.551794042s) [upload=8862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:08.962451691 (8h29m8.551796678s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:09.256530018 (8h29m8.845875005s) [upload=8862]: Done uploading segments... Aug 7 18:09:09.256598799 (8h29m8.845943796s) [upload=8862]: Upload finished. err: <nil> Aug 7 18:09:53.903185086 (8h29m53.492530073s) [upload=8874]: Starting upload Aug 7 18:09:53.903229430 (8h29m53.492574417s) [upload=8874]: Done starting upload Aug 7 18:09:53.903289726 (8h29m53.492634714s) [upload=8874]: Uploading segments... Aug 7 18:09:53.903323862 (8h29m53.492668849s) [upload=8874]: Got next segment. Inline: true Aug 7 18:09:53.903327488 (8h29m53.492672465s) [upload=8874]: Waiting for error group managing segments... Aug 7 18:09:53.903359990 (8h29m53.492704977s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:53.903363988 (8h29m53.492708975s) [upload=8874]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:53.903366563 (8h29m53.49271154s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:54.205270072 (8h29m53.794615059s) [upload=8874]: Done uploading segments... Aug 7 18:09:54.205287746 (8h29m53.794632733s) [upload=8874]: Upload finished. err: <nil> Duration: 2.2259306s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........................XXX.......X..X.....................] duration: 6.151130454s FAIL (2025-08-07 18:18:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 6.151155853s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X..........X....X...........] duration: 1.992763193s FAIL (2025-08-07 18:18:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== pb.BatchRequestItem_SegmentMakeInline Aug 7 18:02:58.324202419 (8h22m57.913547406s) [upload=8751]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:02:58.698491093 (8h22m58.28783608s) [upload=8751]: Done uploading segments... Aug 7 18:02:58.698512194 (8h22m58.287857181s) [upload=8751]: Upload finished. err: <nil> Aug 7 18:03:34.023713956 (8h23m33.613058943s) [upload=8762]: Starting upload Aug 7 18:03:34.023756718 (8h23m33.613101705s) [upload=8762]: Done starting upload Aug 7 18:03:34.023810802 (8h23m33.613155789s) [upload=8762]: Uploading segments... Aug 7 18:03:34.023849966 (8h23m33.613194953s) [upload=8762]: Got next segment. Inline: true Aug 7 18:03:34.023854666 (8h23m33.613199653s) [upload=8762]: Waiting for error group managing segments... Aug 7 18:03:34.023897628 (8h23m33.613242615s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:34.023901234 (8h23m33.613246211s) [upload=8762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:34.023903569 (8h23m33.613248556s) [upload=8762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:34.301041444 (8h23m33.890386431s) [upload=8762]: Done uploading segments... Aug 7 18:03:34.301059288 (8h23m33.890404275s) [upload=8762]: Upload finished. err: <nil> Aug 7 18:03:59.853483337 (8h23m59.442828324s) [upload=8770]: Starting upload Aug 7 18:03:59.853529155 (8h23m59.442874142s) [upload=8770]: Done starting upload Aug 7 18:03:59.853588008 (8h23m59.442932995s) [upload=8770]: Uploading segments... Aug 7 18:03:59.853685885 (8h23m59.443030902s) [upload=8770]: Got next segment. Inline: true Aug 7 18:03:59.853694351 (8h23m59.443039338s) [upload=8770]: Waiting for error group managing segments... Aug 7 18:03:59.853789563 (8h23m59.44313455s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:59.853811105 (8h23m59.443156092s) [upload=8770]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:03:59.853813669 (8h23m59.443158656s) [upload=8770]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:04:00.248702898 (8h23m59.838047905s) [upload=8770]: Done uploading segments... Aug 7 18:04:00.248729179 (8h23m59.838074166s) [upload=8770]: Upload finished. err: <nil> Aug 7 18:05:11.288723553 (8h25m10.87806854s) [upload=8792]: Starting upload Aug 7 18:05:11.288768570 (8h25m10.878113557s) [upload=8792]: Done starting upload Aug 7 18:05:11.288821371 (8h25m10.878166358s) [upload=8792]: Uploading segments... Aug 7 18:05:11.288853282 (8h25m10.878198269s) [upload=8792]: Got next segment. Inline: true Aug 7 18:05:11.288856989 (8h25m10.878201976s) [upload=8792]: Waiting for error group managing segments... Aug 7 18:05:11.288889871 (8h25m10.878234858s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:11.288894972 (8h25m10.878239969s) [upload=8792]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:11.288897246 (8h25m10.878242233s) [upload=8792]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:11.633494661 (8h25m11.222839648s) [upload=8792]: Done uploading segments... Aug 7 18:05:11.633511834 (8h25m11.222856821s) [upload=8792]: Upload finished. err: <nil> Aug 7 18:05:46.281330062 (8h25m45.870675059s) [upload=8802]: Starting upload Aug 7 18:05:46.281387371 (8h25m45.870732358s) [upload=8802]: Done starting upload Aug 7 18:05:46.281445092 (8h25m45.870790079s) [upload=8802]: Uploading segments... Aug 7 18:05:46.281475491 (8h25m45.870820478s) [upload=8802]: Got next segment. Inline: true Aug 7 18:05:46.281479218 (8h25m45.870824205s) [upload=8802]: Waiting for error group managing segments... Aug 7 18:05:46.281513543 (8h25m45.87085853s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:05:46.281517781 (8h25m45.870862768s) [upload=8802]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:05:46.281520146 (8h25m45.870865133s) [upload=8802]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:05:46.556872305 (8h25m46.146217292s) [upload=8802]: Done uploading segments... Aug 7 18:05:46.556891452 (8h25m46.146236439s) [upload=8802]: Upload finished. err: <nil> Aug 7 18:06:26.963610183 (8h26m26.55295517s) [upload=8814]: Starting upload Aug 7 18:06:26.963657103 (8h26m26.55300209s) [upload=8814]: Done starting upload Aug 7 18:06:26.963737527 (8h26m26.553082514s) [upload=8814]: Uploading segments... Aug 7 18:06:26.963867786 (8h26m26.553212783s) [upload=8814]: Got next segment. Inline: true Aug 7 18:06:26.963874910 (8h26m26.553219897s) [upload=8814]: Waiting for error group managing segments... Aug 7 18:06:26.963927700 (8h26m26.553272687s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:26.963934554 (8h26m26.553279541s) [upload=8814]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:26.963937970 (8h26m26.553282957s) [upload=8814]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:27.258606837 (8h26m26.847951824s) [upload=8814]: Done uploading segments... Aug 7 18:06:27.258625452 (8h26m26.84797044s) [upload=8814]: Upload finished. err: <nil> Aug 7 18:06:58.759713181 (8h26m58.349058158s) [upload=8824]: Starting upload Aug 7 18:06:58.759765702 (8h26m58.349110689s) [upload=8824]: Done starting upload Aug 7 18:06:58.759814064 (8h26m58.349159052s) [upload=8824]: Uploading segments... Aug 7 18:06:58.759845304 (8h26m58.349190291s) [upload=8824]: Got next segment. Inline: true Aug 7 18:06:58.759849382 (8h26m58.349194369s) [upload=8824]: Waiting for error group managing segments... Aug 7 18:06:58.759883998 (8h26m58.349228985s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:06:58.759888256 (8h26m58.349233243s) [upload=8824]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:06:58.759892514 (8h26m58.349237501s) [upload=8824]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:06:59.029430588 (8h26m58.618775575s) [upload=8824]: Done uploading segments... Aug 7 18:06:59.029447962 (8h26m58.618792949s) [upload=8824]: Upload finished. err: <nil> Aug 7 18:07:21.849459220 (8h27m21.438804207s) [upload=8832]: Starting upload Aug 7 18:07:21.849502753 (8h27m21.43884774s) [upload=8832]: Done starting upload Aug 7 18:07:21.849555023 (8h27m21.43890001s) [upload=8832]: Uploading segments... Aug 7 18:07:21.849584629 (8h27m21.438929606s) [upload=8832]: Got next segment. Inline: true Aug 7 18:07:21.849588207 (8h27m21.438933194s) [upload=8832]: Waiting for error group managing segments... Aug 7 18:07:21.849642782 (8h27m21.438987769s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:07:21.849646969 (8h27m21.438991946s) [upload=8832]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:07:21.849649234 (8h27m21.438994221s) [upload=8832]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:07:22.125155216 (8h27m21.714500193s) [upload=8832]: Done uploading segments... Aug 7 18:07:22.125168983 (8h27m21.71451397s) [upload=8832]: Upload finished. err: <nil> Aug 7 18:08:04.258700436 (8h28m3.848045423s) [upload=8844]: Starting upload Aug 7 18:08:04.258764518 (8h28m3.848109505s) [upload=8844]: Done starting upload Aug 7 18:08:04.258817950 (8h28m3.848162937s) [upload=8844]: Uploading segments... Aug 7 18:08:04.258851825 (8h28m3.848196812s) [upload=8844]: Got next segment. Inline: true Aug 7 18:08:04.258856134 (8h28m3.848201121s) [upload=8844]: Waiting for error group managing segments... Aug 7 18:08:04.258889087 (8h28m3.848234074s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:08:04.258893615 (8h28m3.848238602s) [upload=8844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:08:04.258896881 (8h28m3.848241868s) [upload=8844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:08:04.739572923 (8h28m4.32891791s) [upload=8844]: Done uploading segments... Aug 7 18:08:04.739591489 (8h28m4.328936476s) [upload=8844]: Upload finished. err: <nil> Aug 7 18:09:08.962290352 (8h29m8.551635339s) [upload=8862]: Starting upload Aug 7 18:09:08.962325299 (8h29m8.551670286s) [upload=8862]: Done starting upload Aug 7 18:09:08.962367259 (8h29m8.551712246s) [upload=8862]: Uploading segments... Aug 7 18:09:08.962397838 (8h29m8.551742825s) [upload=8862]: Got next segment. Inline: true Aug 7 18:09:08.962401585 (8h29m8.551746572s) [upload=8862]: Waiting for error group managing segments... Aug 7 18:09:08.962444857 (8h29m8.551789844s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:08.962449055 (8h29m8.551794042s) [upload=8862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:08.962451691 (8h29m8.551796678s) [upload=8862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:09.256530018 (8h29m8.845875005s) [upload=8862]: Done uploading segments... Aug 7 18:09:09.256598799 (8h29m8.845943796s) [upload=8862]: Upload finished. err: <nil> Aug 7 18:09:53.903185086 (8h29m53.492530073s) [upload=8874]: Starting upload Aug 7 18:09:53.903229430 (8h29m53.492574417s) [upload=8874]: Done starting upload Aug 7 18:09:53.903289726 (8h29m53.492634714s) [upload=8874]: Uploading segments... Aug 7 18:09:53.903323862 (8h29m53.492668849s) [upload=8874]: Got next segment. Inline: true Aug 7 18:09:53.903327488 (8h29m53.492672465s) [upload=8874]: Waiting for error group managing segments... Aug 7 18:09:53.903359990 (8h29m53.492704977s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:09:53.903363988 (8h29m53.492708975s) [upload=8874]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 18:09:53.903366563 (8h29m53.49271154s) [upload=8874]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:09:54.205270072 (8h29m53.794615059s) [upload=8874]: Done uploading segments... Aug 7 18:09:54.205287746 (8h29m53.794632733s) [upload=8874]: Upload finished. err: <nil> Duration: 1.9927925s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........................XXX.......X..X....................] duration: 6.045776691s FAIL (2025-08-07 18:18:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 6.045804525s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...........................XXX.......X..X...................] duration: 6.053198412s FAIL (2025-08-07 18:17:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== e=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246329474 (8h23m5.835674461s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.246647382 (8h23m5.835992389s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247384402 (8h23m5.836729389s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247645822 (8h23m5.836990809s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247858339 (8h23m5.837203326s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.247887695 (8h23m5.837232682s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248302689 (8h23m5.837647676s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.248753101 (8h23m5.838098088s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249165820 (8h23m5.838510807s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.249591936 (8h23m5.838936923s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250046225 (8h23m5.839391212s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250465617 (8h23m5.839810604s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.250886683 (8h23m5.8402317s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.252128609 (8h23m5.841473596s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.253240015 (8h23m5.842585012s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:06.254658129 (8h23m5.844003156s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Uploading piece... Aug 7 18:03:07.364269399 (8h23m6.953614376s) [upload=8754]: Next returned nil segment Aug 7 18:03:07.364286913 (8h23m6.95363189s) [upload=8754]: Waiting for error group managing segments... Aug 7 18:03:07.673300135 (8h23m7.262645123s) [noise=true , address=64.49.13.140:4511 , piece_id=7HRZNC6JRVMWRLV65YAE3BQCDQBO75R2L5637AV5XWLY2BVMATKA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:07.692124972 (8h23m7.281469949s) [noise=true , address=64.49.13.26:4945 , piece_id=LICXRKOSSUHUSUIOPDJN7QZ5UXLZTFXA3F7DVQ7MK7ZLYL525DTQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184655888 (8h23m7.774000875s) [noise=true , address=104.36.82.55:4210 , piece_id=5BMNCME34WPD246GCZJQEVZXQED4C3KO52GCSVUXPLQQNK7AJYGA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.184675927 (8h23m7.774020914s) [noise=true , address=104.36.82.37:4672 , piece_id=BRRS5SZKB3F745QNDP67ESAEAFHWLBCKOPIH2Z3TUTQVJSFGUAAQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.210806672 (8h23m7.800151659s) [noise=true , address=104.36.82.45:4939 , piece_id=ZR2LKEL4W5UCX4XPAWSFGSGV73PEZSMUTNELPSKTYRSBNR5HKY5Q, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.241913799 (8h23m7.831258796s) [noise=true , address=104.36.82.8:4994 , piece_id=3HIFBLCQDKOUWWRV33T2UWCBHOYJPG4CVM4KEHLVWWSK4YDKYLAA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.254654997 (8h23m7.843999984s) [noise=true , address=104.36.82.5:4872 , piece_id=6SNZJCFCITZ4TOVALFDGXVKMIJRQ5F5OLQEBGH72PQH7S5DRPVNQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.277607612 (8h23m7.866952599s) [noise=true , address=104.36.82.56:4256 , piece_id=ZXESY6UGJTAAND35FXZR5LU4QNYQ6E6SQGSXTEUEPJVHQWGQMTGQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.289610297 (8h23m7.878955324s) [noise=true , address=104.36.82.42:4832 , piece_id=OBI3NLZ22AVSTC4UCHDRJNG57ZJB2JAOJOUR77EPZFKNMGVPD2OA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.311305837 (8h23m7.900650824s) [noise=true , address=104.36.82.35:4611 , piece_id=MQPXWU5W56AFEX7YB2FRMJQZW7XYGCJN5VVURGEKBE5PNJ7PKNFA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.336143870 (8h23m7.925488847s) [noise=true , address=104.36.82.59:4313 , piece_id=LKPVBLHJZHCLMO4MXJELKFJYJQOAARNK23QG7P7HY5PPEEPMPOOQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.341878110 (8h23m7.931223097s) [noise=true , address=104.36.82.46:4504 , piece_id=BNS7MP27RT3U7AVFQ7RS2VDSFW4XY6GEAIUBX3DGOU7CY5UN62BQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.351399628 (8h23m7.940744615s) [noise=true , address=104.36.82.16:4299 , piece_id=VWLFKNQD3IXL6N6RIDCPJRUTQUCBWTJ5TGQK6OPWQPUKOVTSGUZA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353409363 (8h23m7.94275434s) [noise=true , address=104.36.82.61:4382 , piece_id=DNC5RCHAFJC6HCSQEITZX2PZRXM63GSLVPLZPSDM5QTC3ABYDNVQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: <nil> Aug 7 18:03:08.353424572 (8h23m7.942769559s) [seg_pos={0 0}, upload=8754]: Segment reached optimal threshold of 14 pieces. Aug 7 18:03:08.353635446 (8h23m7.942980423s) [noise=true , address=104.36.82.60:4354 , piece_id=MKA5PMQM2GJKGS2BU223AAQCV2FTJ6FF57O5RI5AAVRSZMNLEXJA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KTMqMAjUKJ6NFK3tKvnpcKzdSxfnXTBC1hvWce28g3nP3Rhnv): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353707804 (8h23m7.943052781s) [noise=true , address=45.91.116.8:4067 , piece_id=O6OOZG3SHQAGMG36XBF36P3GJHJ7LI5QYRD3RN4I3EEVC7QWV4JQ, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FDuuKhSWcQT3kRLyLd8g84Fu8VRZAwAKX3dLB4RjsXYmqdjTp): protocol: expected piece hash; context canceled; EOF Aug 7 18:03:08.353739585 (8h23m7.943084562s) [noise=true , address=104.36.82.23:4454 , piece_id=P5JYXDGZQWUEFJOMI2JUSLQP76LUBKOSTB5PJPFFWT3OWV5YBRBA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: rpc: dial tcp 104.36.82.23:4454: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 18:03:08.353780403 (8h23m7.94312539s) [noise=true , address=104.36.82.58:4285 , piece_id=PNEQ5HY6XP6BOLXJVYJNSWRTL5D7P6QPBURS5ZVD2ALJFISFNRCA, seg_pos={0 0}, upload=8754]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rZhbymrDS6ahXLEqYRM64gcqRvG8CEnc8iGCTEhgXrpvRaQrp): protocol: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:60120->104.36.82.58:4285: use of closed network connection Aug 7 18:03:08.353824899 (8h23m7.943169886s) [seg_pos={0 0}, upload=8754]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 18:03:08.353904971 (8h23m7.943249958s) [upload=8754]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 18:03:08.353908899 (8h23m7.943253876s) [upload=8754]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 18:03:08.643261075 (8h23m8.232606062s) [upload=8754]: Done uploading segments... Aug 7 18:03:08.643282024 (8h23m8.232627001s) [upload=8754]: Upload finished. err: <nil> Aug 7 18:03:50.182501705 (8h23m49.771846692s) [upload=8765]: Starting upload Aug 7 18:03:50.182547052 (8h23m49.771892039s) [upload=8765]: Done starting upload Aug 7 18:03:50.182714803 (8h23m49.77205979s) [upload=8765]: Uploading segments... Aug 7 18:03:50.182745772 (8h23m49.772090759s) [upload=8765]: Got next segment. Inline: false Aug 7 18:03:50.182770059 (8h23m49.772115046s) [upload=8765]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 18:03:50.182774327 (8h23m49.772119314s) [upload=8765]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 18:03:50.409270941 (8h23m49.998615928s) [upload=8765]: Next segment err: metaclient: Too Many Requests Aug 7 18:03:50.409291371 (8h23m49.998636358s) [upload=8765]: Done uploading segments... Aug 7 18:03:50.409306419 (8h23m49.998651406s) [upload=8765]: Upload finished. err: metaclient: Too Many Requests Duration: 6.053224393s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)