Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.......X..............X.....] duration: 1.857505752s FAIL (2025-08-08 03:07:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ne uploading segments... Aug 8 02:56:20.024202387 (17h16m19.613547374s) [upload=17888]: Upload finished. err: <nil> Aug 8 02:57:21.936712176 (17h17m21.526057163s) [upload=17907]: Starting upload Aug 8 02:57:21.936755830 (17h17m21.526100817s) [upload=17907]: Done starting upload Aug 8 02:57:21.936827617 (17h17m21.526172604s) [upload=17907]: Uploading segments... Aug 8 02:57:21.936859688 (17h17m21.526204685s) [upload=17907]: Got next segment. Inline: true Aug 8 02:57:21.936863435 (17h17m21.526208412s) [upload=17907]: Waiting for error group managing segments... Aug 8 02:57:21.936926376 (17h17m21.526271363s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:21.936930744 (17h17m21.526275732s) [upload=17907]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:21.936933590 (17h17m21.526278577s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:22.506444375 (17h17m22.095789373s) [upload=17907]: Done uploading segments... Aug 8 02:57:22.506475124 (17h17m22.095820101s) [upload=17907]: Upload finished. err: <nil> Aug 8 02:57:37.317930907 (17h17m36.907275904s) [upload=17911]: Starting upload Aug 8 02:57:37.317997885 (17h17m36.907342892s) [upload=17911]: Done starting upload Aug 8 02:57:37.318090021 (17h17m36.907435008s) [upload=17911]: Uploading segments... Aug 8 02:57:37.318259555 (17h17m36.907604562s) [upload=17911]: Got next segment. Inline: true Aug 8 02:57:37.318268222 (17h17m36.907613209s) [upload=17911]: Waiting for error group managing segments... Aug 8 02:57:37.318340520 (17h17m36.907685507s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:37.318346793 (17h17m36.90769178s) [upload=17911]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:37.318350209 (17h17m36.907695196s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:37.606185349 (17h17m37.195530326s) [upload=17911]: Done uploading segments... Aug 8 02:57:37.606203374 (17h17m37.195548361s) [upload=17911]: Upload finished. err: <nil> Aug 8 02:58:21.814121097 (17h18m21.403466084s) [upload=17922]: Starting upload Aug 8 02:58:21.814163258 (17h18m21.403508246s) [upload=17922]: Done starting upload Aug 8 02:58:21.814208725 (17h18m21.403553712s) [upload=17922]: Uploading segments... Aug 8 02:58:21.814237340 (17h18m21.403582327s) [upload=17922]: Got next segment. Inline: true Aug 8 02:58:21.814241047 (17h18m21.403586035s) [upload=17922]: Waiting for error group managing segments... Aug 8 02:58:21.814274962 (17h18m21.403619949s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:21.814278459 (17h18m21.403623446s) [upload=17922]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:21.814280823 (17h18m21.4036258s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:22.119464144 (17h18m21.708809131s) [upload=17922]: Done uploading segments... Aug 8 02:58:22.119486626 (17h18m21.708831654s) [upload=17922]: Upload finished. err: <nil> Aug 8 02:58:38.525992119 (17h18m38.115337106s) [upload=17925]: Starting upload Aug 8 02:58:38.526039660 (17h18m38.115384637s) [upload=17925]: Done starting upload Aug 8 02:58:38.526083594 (17h18m38.115428581s) [upload=17925]: Uploading segments... Aug 8 02:58:38.526113942 (17h18m38.115458919s) [upload=17925]: Got next segment. Inline: true Aug 8 02:58:38.526117620 (17h18m38.115462607s) [upload=17925]: Waiting for error group managing segments... Aug 8 02:58:38.526148008 (17h18m38.115492995s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:38.526151975 (17h18m38.115496962s) [upload=17925]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:38.526154329 (17h18m38.115499317s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:38.814559291 (17h18m38.403904268s) [upload=17925]: Done uploading segments... Aug 8 02:58:38.814575763 (17h18m38.40392075s) [upload=17925]: Upload finished. err: <nil> Aug 8 02:59:50.786538839 (17h19m50.375883826s) [upload=17947]: Starting upload Aug 8 02:59:50.786576711 (17h19m50.375921698s) [upload=17947]: Done starting upload Aug 8 02:59:50.786634171 (17h19m50.375979158s) [upload=17947]: Uploading segments... Aug 8 02:59:50.786663447 (17h19m50.376008434s) [upload=17947]: Got next segment. Inline: true Aug 8 02:59:50.786667324 (17h19m50.376012311s) [upload=17947]: Waiting for error group managing segments... Aug 8 02:59:50.786704085 (17h19m50.376049072s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:50.786707762 (17h19m50.376052749s) [upload=17947]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:50.786710096 (17h19m50.376055073s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:51.106334579 (17h19m50.695679556s) [upload=17947]: Done uploading segments... Aug 8 02:59:51.106377160 (17h19m50.695722147s) [upload=17947]: Upload finished. err: <nil> Aug 8 03:00:55.579919358 (17h20m55.169264345s) [upload=17972]: Starting upload Aug 8 03:00:55.579968011 (17h20m55.169312998s) [upload=17972]: Done starting upload Aug 8 03:00:55.580038948 (17h20m55.169383935s) [upload=17972]: Uploading segments... Aug 8 03:00:55.580135742 (17h20m55.169480729s) [upload=17972]: Got next segment. Inline: true Aug 8 03:00:55.580140883 (17h20m55.16948587s) [upload=17972]: Waiting for error group managing segments... Aug 8 03:00:55.580195307 (17h20m55.169540294s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:55.580200797 (17h20m55.169545784s) [upload=17972]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:55.580203292 (17h20m55.169548279s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:55.912085837 (17h20m55.501430824s) [upload=17972]: Done uploading segments... Aug 8 03:00:55.912105655 (17h20m55.501450642s) [upload=17972]: Upload finished. err: <nil> Aug 8 03:01:11.133547907 (17h21m10.722892884s) [upload=17973]: Starting upload Aug 8 03:01:11.133591461 (17h21m10.722936448s) [upload=17973]: Done starting upload Aug 8 03:01:11.133640935 (17h21m10.722985922s) [upload=17973]: Uploading segments... Aug 8 03:01:11.133672034 (17h21m10.723017021s) [upload=17973]: Got next segment. Inline: true Aug 8 03:01:11.133676524 (17h21m10.723021511s) [upload=17973]: Waiting for error group managing segments... Aug 8 03:01:11.133708765 (17h21m10.723053752s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:01:11.133712672 (17h21m10.723057659s) [upload=17973]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:11.133715087 (17h21m10.723060074s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:01:11.449374683 (17h21m11.03871967s) [upload=17973]: Done uploading segments... Aug 8 03:01:11.449394041 (17h21m11.038739028s) [upload=17973]: Upload finished. err: <nil> Aug 8 03:02:06.650900829 (17h22m6.240245806s) [upload=17992]: Starting upload Aug 8 03:02:06.650935946 (17h22m6.240280933s) [upload=17992]: Done starting upload Aug 8 03:02:06.650995931 (17h22m6.240340908s) [upload=17992]: Uploading segments... Aug 8 03:02:06.651029084 (17h22m6.240374071s) [upload=17992]: Got next segment. Inline: true Aug 8 03:02:06.651032301 (17h22m6.240377288s) [upload=17992]: Waiting for error group managing segments... Aug 8 03:02:06.651062359 (17h22m6.240407346s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:02:06.651065955 (17h22m6.240410942s) [upload=17992]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:06.651068059 (17h22m6.240413046s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:02:06.973370836 (17h22m6.562715823s) [upload=17992]: Done uploading segments... Aug 8 03:02:06.973388198 (17h22m6.562733185s) [upload=17992]: Upload finished. err: <nil> Aug 8 03:03:17.244757731 (17h23m16.834102718s) [upload=18011]: Starting upload Aug 8 03:03:17.244809900 (17h23m16.834154887s) [upload=18011]: Done starting upload Aug 8 03:03:17.244897138 (17h23m16.834242125s) [upload=18011]: Uploading segments... Aug 8 03:03:17.245001527 (17h23m16.834346514s) [upload=18011]: Got next segment. Inline: true Aug 8 03:03:17.245017979 (17h23m16.834362956s) [upload=18011]: Waiting for error group managing segments... Aug 8 03:03:17.245061272 (17h23m16.834406259s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:17.245066051 (17h23m16.834411038s) [upload=18011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:17.245068295 (17h23m16.834413282s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:17.537334768 (17h23m17.126679755s) [upload=18011]: Done uploading segments... Aug 8 03:03:17.537351780 (17h23m17.126696767s) [upload=18011]: Upload finished. err: <nil> Aug 8 03:03:52.908542382 (17h23m52.497887379s) [upload=18020]: Starting upload Aug 8 03:03:52.908632545 (17h23m52.497977562s) [upload=18020]: Done starting upload Aug 8 03:03:52.908719050 (17h23m52.498064108s) [upload=18020]: Uploading segments... Aug 8 03:03:52.908833700 (17h23m52.498178767s) [upload=18020]: Got next segment. Inline: true Aug 8 03:03:52.908840983 (17h23m52.49818604s) [upload=18020]: Waiting for error group managing segments... Aug 8 03:03:52.908894395 (17h23m52.498239393s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:52.908901379 (17h23m52.498246426s) [upload=18020]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:52.908907591 (17h23m52.498252648s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:53.211413265 (17h23m52.800758252s) [upload=18020]: Done uploading segments... Aug 8 03:03:53.211436890 (17h23m52.800781877s) [upload=18020]: Upload finished. err: <nil> Duration: 1.85754064s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X...........X.............................X............] duration: 5.951407656s FAIL (2025-08-08 03:07:54 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 5.951434568s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X.......X..............X....] duration: 1.840676723s FAIL (2025-08-08 03:06:49 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ne uploading segments... Aug 8 02:56:20.024202387 (17h16m19.613547374s) [upload=17888]: Upload finished. err: <nil> Aug 8 02:57:21.936712176 (17h17m21.526057163s) [upload=17907]: Starting upload Aug 8 02:57:21.936755830 (17h17m21.526100817s) [upload=17907]: Done starting upload Aug 8 02:57:21.936827617 (17h17m21.526172604s) [upload=17907]: Uploading segments... Aug 8 02:57:21.936859688 (17h17m21.526204685s) [upload=17907]: Got next segment. Inline: true Aug 8 02:57:21.936863435 (17h17m21.526208412s) [upload=17907]: Waiting for error group managing segments... Aug 8 02:57:21.936926376 (17h17m21.526271363s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:21.936930744 (17h17m21.526275732s) [upload=17907]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:21.936933590 (17h17m21.526278577s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:22.506444375 (17h17m22.095789373s) [upload=17907]: Done uploading segments... Aug 8 02:57:22.506475124 (17h17m22.095820101s) [upload=17907]: Upload finished. err: <nil> Aug 8 02:57:37.317930907 (17h17m36.907275904s) [upload=17911]: Starting upload Aug 8 02:57:37.317997885 (17h17m36.907342892s) [upload=17911]: Done starting upload Aug 8 02:57:37.318090021 (17h17m36.907435008s) [upload=17911]: Uploading segments... Aug 8 02:57:37.318259555 (17h17m36.907604562s) [upload=17911]: Got next segment. Inline: true Aug 8 02:57:37.318268222 (17h17m36.907613209s) [upload=17911]: Waiting for error group managing segments... Aug 8 02:57:37.318340520 (17h17m36.907685507s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:37.318346793 (17h17m36.90769178s) [upload=17911]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:37.318350209 (17h17m36.907695196s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:37.606185349 (17h17m37.195530326s) [upload=17911]: Done uploading segments... Aug 8 02:57:37.606203374 (17h17m37.195548361s) [upload=17911]: Upload finished. err: <nil> Aug 8 02:58:21.814121097 (17h18m21.403466084s) [upload=17922]: Starting upload Aug 8 02:58:21.814163258 (17h18m21.403508246s) [upload=17922]: Done starting upload Aug 8 02:58:21.814208725 (17h18m21.403553712s) [upload=17922]: Uploading segments... Aug 8 02:58:21.814237340 (17h18m21.403582327s) [upload=17922]: Got next segment. Inline: true Aug 8 02:58:21.814241047 (17h18m21.403586035s) [upload=17922]: Waiting for error group managing segments... Aug 8 02:58:21.814274962 (17h18m21.403619949s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:21.814278459 (17h18m21.403623446s) [upload=17922]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:21.814280823 (17h18m21.4036258s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:22.119464144 (17h18m21.708809131s) [upload=17922]: Done uploading segments... Aug 8 02:58:22.119486626 (17h18m21.708831654s) [upload=17922]: Upload finished. err: <nil> Aug 8 02:58:38.525992119 (17h18m38.115337106s) [upload=17925]: Starting upload Aug 8 02:58:38.526039660 (17h18m38.115384637s) [upload=17925]: Done starting upload Aug 8 02:58:38.526083594 (17h18m38.115428581s) [upload=17925]: Uploading segments... Aug 8 02:58:38.526113942 (17h18m38.115458919s) [upload=17925]: Got next segment. Inline: true Aug 8 02:58:38.526117620 (17h18m38.115462607s) [upload=17925]: Waiting for error group managing segments... Aug 8 02:58:38.526148008 (17h18m38.115492995s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:38.526151975 (17h18m38.115496962s) [upload=17925]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:38.526154329 (17h18m38.115499317s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:38.814559291 (17h18m38.403904268s) [upload=17925]: Done uploading segments... Aug 8 02:58:38.814575763 (17h18m38.40392075s) [upload=17925]: Upload finished. err: <nil> Aug 8 02:59:50.786538839 (17h19m50.375883826s) [upload=17947]: Starting upload Aug 8 02:59:50.786576711 (17h19m50.375921698s) [upload=17947]: Done starting upload Aug 8 02:59:50.786634171 (17h19m50.375979158s) [upload=17947]: Uploading segments... Aug 8 02:59:50.786663447 (17h19m50.376008434s) [upload=17947]: Got next segment. Inline: true Aug 8 02:59:50.786667324 (17h19m50.376012311s) [upload=17947]: Waiting for error group managing segments... Aug 8 02:59:50.786704085 (17h19m50.376049072s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:50.786707762 (17h19m50.376052749s) [upload=17947]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:50.786710096 (17h19m50.376055073s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:51.106334579 (17h19m50.695679556s) [upload=17947]: Done uploading segments... Aug 8 02:59:51.106377160 (17h19m50.695722147s) [upload=17947]: Upload finished. err: <nil> Aug 8 03:00:55.579919358 (17h20m55.169264345s) [upload=17972]: Starting upload Aug 8 03:00:55.579968011 (17h20m55.169312998s) [upload=17972]: Done starting upload Aug 8 03:00:55.580038948 (17h20m55.169383935s) [upload=17972]: Uploading segments... Aug 8 03:00:55.580135742 (17h20m55.169480729s) [upload=17972]: Got next segment. Inline: true Aug 8 03:00:55.580140883 (17h20m55.16948587s) [upload=17972]: Waiting for error group managing segments... Aug 8 03:00:55.580195307 (17h20m55.169540294s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:55.580200797 (17h20m55.169545784s) [upload=17972]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:55.580203292 (17h20m55.169548279s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:55.912085837 (17h20m55.501430824s) [upload=17972]: Done uploading segments... Aug 8 03:00:55.912105655 (17h20m55.501450642s) [upload=17972]: Upload finished. err: <nil> Aug 8 03:01:11.133547907 (17h21m10.722892884s) [upload=17973]: Starting upload Aug 8 03:01:11.133591461 (17h21m10.722936448s) [upload=17973]: Done starting upload Aug 8 03:01:11.133640935 (17h21m10.722985922s) [upload=17973]: Uploading segments... Aug 8 03:01:11.133672034 (17h21m10.723017021s) [upload=17973]: Got next segment. Inline: true Aug 8 03:01:11.133676524 (17h21m10.723021511s) [upload=17973]: Waiting for error group managing segments... Aug 8 03:01:11.133708765 (17h21m10.723053752s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:01:11.133712672 (17h21m10.723057659s) [upload=17973]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:11.133715087 (17h21m10.723060074s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:01:11.449374683 (17h21m11.03871967s) [upload=17973]: Done uploading segments... Aug 8 03:01:11.449394041 (17h21m11.038739028s) [upload=17973]: Upload finished. err: <nil> Aug 8 03:02:06.650900829 (17h22m6.240245806s) [upload=17992]: Starting upload Aug 8 03:02:06.650935946 (17h22m6.240280933s) [upload=17992]: Done starting upload Aug 8 03:02:06.650995931 (17h22m6.240340908s) [upload=17992]: Uploading segments... Aug 8 03:02:06.651029084 (17h22m6.240374071s) [upload=17992]: Got next segment. Inline: true Aug 8 03:02:06.651032301 (17h22m6.240377288s) [upload=17992]: Waiting for error group managing segments... Aug 8 03:02:06.651062359 (17h22m6.240407346s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:02:06.651065955 (17h22m6.240410942s) [upload=17992]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:06.651068059 (17h22m6.240413046s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:02:06.973370836 (17h22m6.562715823s) [upload=17992]: Done uploading segments... Aug 8 03:02:06.973388198 (17h22m6.562733185s) [upload=17992]: Upload finished. err: <nil> Aug 8 03:03:17.244757731 (17h23m16.834102718s) [upload=18011]: Starting upload Aug 8 03:03:17.244809900 (17h23m16.834154887s) [upload=18011]: Done starting upload Aug 8 03:03:17.244897138 (17h23m16.834242125s) [upload=18011]: Uploading segments... Aug 8 03:03:17.245001527 (17h23m16.834346514s) [upload=18011]: Got next segment. Inline: true Aug 8 03:03:17.245017979 (17h23m16.834362956s) [upload=18011]: Waiting for error group managing segments... Aug 8 03:03:17.245061272 (17h23m16.834406259s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:17.245066051 (17h23m16.834411038s) [upload=18011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:17.245068295 (17h23m16.834413282s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:17.537334768 (17h23m17.126679755s) [upload=18011]: Done uploading segments... Aug 8 03:03:17.537351780 (17h23m17.126696767s) [upload=18011]: Upload finished. err: <nil> Aug 8 03:03:52.908542382 (17h23m52.497887379s) [upload=18020]: Starting upload Aug 8 03:03:52.908632545 (17h23m52.497977562s) [upload=18020]: Done starting upload Aug 8 03:03:52.908719050 (17h23m52.498064108s) [upload=18020]: Uploading segments... Aug 8 03:03:52.908833700 (17h23m52.498178767s) [upload=18020]: Got next segment. Inline: true Aug 8 03:03:52.908840983 (17h23m52.49818604s) [upload=18020]: Waiting for error group managing segments... Aug 8 03:03:52.908894395 (17h23m52.498239393s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:52.908901379 (17h23m52.498246426s) [upload=18020]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:52.908907591 (17h23m52.498252648s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:53.211413265 (17h23m52.800758252s) [upload=18020]: Done uploading segments... Aug 8 03:03:53.211436890 (17h23m52.800781877s) [upload=18020]: Upload finished. err: <nil> Duration: 1.840712302s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...........X.............................X...........] duration: 5.72078623s FAIL (2025-08-08 03:06:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 5.720815806s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X...........X.............................X..........] duration: 6.031883953s FAIL (2025-08-08 03:06:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 6.031917498s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.......X..............X...] duration: 1.972470685s FAIL (2025-08-08 03:05:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ne uploading segments... Aug 8 02:56:20.024202387 (17h16m19.613547374s) [upload=17888]: Upload finished. err: <nil> Aug 8 02:57:21.936712176 (17h17m21.526057163s) [upload=17907]: Starting upload Aug 8 02:57:21.936755830 (17h17m21.526100817s) [upload=17907]: Done starting upload Aug 8 02:57:21.936827617 (17h17m21.526172604s) [upload=17907]: Uploading segments... Aug 8 02:57:21.936859688 (17h17m21.526204685s) [upload=17907]: Got next segment. Inline: true Aug 8 02:57:21.936863435 (17h17m21.526208412s) [upload=17907]: Waiting for error group managing segments... Aug 8 02:57:21.936926376 (17h17m21.526271363s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:21.936930744 (17h17m21.526275732s) [upload=17907]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:21.936933590 (17h17m21.526278577s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:22.506444375 (17h17m22.095789373s) [upload=17907]: Done uploading segments... Aug 8 02:57:22.506475124 (17h17m22.095820101s) [upload=17907]: Upload finished. err: <nil> Aug 8 02:57:37.317930907 (17h17m36.907275904s) [upload=17911]: Starting upload Aug 8 02:57:37.317997885 (17h17m36.907342892s) [upload=17911]: Done starting upload Aug 8 02:57:37.318090021 (17h17m36.907435008s) [upload=17911]: Uploading segments... Aug 8 02:57:37.318259555 (17h17m36.907604562s) [upload=17911]: Got next segment. Inline: true Aug 8 02:57:37.318268222 (17h17m36.907613209s) [upload=17911]: Waiting for error group managing segments... Aug 8 02:57:37.318340520 (17h17m36.907685507s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:37.318346793 (17h17m36.90769178s) [upload=17911]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:37.318350209 (17h17m36.907695196s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:37.606185349 (17h17m37.195530326s) [upload=17911]: Done uploading segments... Aug 8 02:57:37.606203374 (17h17m37.195548361s) [upload=17911]: Upload finished. err: <nil> Aug 8 02:58:21.814121097 (17h18m21.403466084s) [upload=17922]: Starting upload Aug 8 02:58:21.814163258 (17h18m21.403508246s) [upload=17922]: Done starting upload Aug 8 02:58:21.814208725 (17h18m21.403553712s) [upload=17922]: Uploading segments... Aug 8 02:58:21.814237340 (17h18m21.403582327s) [upload=17922]: Got next segment. Inline: true Aug 8 02:58:21.814241047 (17h18m21.403586035s) [upload=17922]: Waiting for error group managing segments... Aug 8 02:58:21.814274962 (17h18m21.403619949s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:21.814278459 (17h18m21.403623446s) [upload=17922]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:21.814280823 (17h18m21.4036258s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:22.119464144 (17h18m21.708809131s) [upload=17922]: Done uploading segments... Aug 8 02:58:22.119486626 (17h18m21.708831654s) [upload=17922]: Upload finished. err: <nil> Aug 8 02:58:38.525992119 (17h18m38.115337106s) [upload=17925]: Starting upload Aug 8 02:58:38.526039660 (17h18m38.115384637s) [upload=17925]: Done starting upload Aug 8 02:58:38.526083594 (17h18m38.115428581s) [upload=17925]: Uploading segments... Aug 8 02:58:38.526113942 (17h18m38.115458919s) [upload=17925]: Got next segment. Inline: true Aug 8 02:58:38.526117620 (17h18m38.115462607s) [upload=17925]: Waiting for error group managing segments... Aug 8 02:58:38.526148008 (17h18m38.115492995s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:38.526151975 (17h18m38.115496962s) [upload=17925]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:38.526154329 (17h18m38.115499317s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:38.814559291 (17h18m38.403904268s) [upload=17925]: Done uploading segments... Aug 8 02:58:38.814575763 (17h18m38.40392075s) [upload=17925]: Upload finished. err: <nil> Aug 8 02:59:50.786538839 (17h19m50.375883826s) [upload=17947]: Starting upload Aug 8 02:59:50.786576711 (17h19m50.375921698s) [upload=17947]: Done starting upload Aug 8 02:59:50.786634171 (17h19m50.375979158s) [upload=17947]: Uploading segments... Aug 8 02:59:50.786663447 (17h19m50.376008434s) [upload=17947]: Got next segment. Inline: true Aug 8 02:59:50.786667324 (17h19m50.376012311s) [upload=17947]: Waiting for error group managing segments... Aug 8 02:59:50.786704085 (17h19m50.376049072s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:50.786707762 (17h19m50.376052749s) [upload=17947]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:50.786710096 (17h19m50.376055073s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:51.106334579 (17h19m50.695679556s) [upload=17947]: Done uploading segments... Aug 8 02:59:51.106377160 (17h19m50.695722147s) [upload=17947]: Upload finished. err: <nil> Aug 8 03:00:55.579919358 (17h20m55.169264345s) [upload=17972]: Starting upload Aug 8 03:00:55.579968011 (17h20m55.169312998s) [upload=17972]: Done starting upload Aug 8 03:00:55.580038948 (17h20m55.169383935s) [upload=17972]: Uploading segments... Aug 8 03:00:55.580135742 (17h20m55.169480729s) [upload=17972]: Got next segment. Inline: true Aug 8 03:00:55.580140883 (17h20m55.16948587s) [upload=17972]: Waiting for error group managing segments... Aug 8 03:00:55.580195307 (17h20m55.169540294s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:55.580200797 (17h20m55.169545784s) [upload=17972]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:55.580203292 (17h20m55.169548279s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:55.912085837 (17h20m55.501430824s) [upload=17972]: Done uploading segments... Aug 8 03:00:55.912105655 (17h20m55.501450642s) [upload=17972]: Upload finished. err: <nil> Aug 8 03:01:11.133547907 (17h21m10.722892884s) [upload=17973]: Starting upload Aug 8 03:01:11.133591461 (17h21m10.722936448s) [upload=17973]: Done starting upload Aug 8 03:01:11.133640935 (17h21m10.722985922s) [upload=17973]: Uploading segments... Aug 8 03:01:11.133672034 (17h21m10.723017021s) [upload=17973]: Got next segment. Inline: true Aug 8 03:01:11.133676524 (17h21m10.723021511s) [upload=17973]: Waiting for error group managing segments... Aug 8 03:01:11.133708765 (17h21m10.723053752s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:01:11.133712672 (17h21m10.723057659s) [upload=17973]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:11.133715087 (17h21m10.723060074s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:01:11.449374683 (17h21m11.03871967s) [upload=17973]: Done uploading segments... Aug 8 03:01:11.449394041 (17h21m11.038739028s) [upload=17973]: Upload finished. err: <nil> Aug 8 03:02:06.650900829 (17h22m6.240245806s) [upload=17992]: Starting upload Aug 8 03:02:06.650935946 (17h22m6.240280933s) [upload=17992]: Done starting upload Aug 8 03:02:06.650995931 (17h22m6.240340908s) [upload=17992]: Uploading segments... Aug 8 03:02:06.651029084 (17h22m6.240374071s) [upload=17992]: Got next segment. Inline: true Aug 8 03:02:06.651032301 (17h22m6.240377288s) [upload=17992]: Waiting for error group managing segments... Aug 8 03:02:06.651062359 (17h22m6.240407346s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:02:06.651065955 (17h22m6.240410942s) [upload=17992]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:06.651068059 (17h22m6.240413046s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:02:06.973370836 (17h22m6.562715823s) [upload=17992]: Done uploading segments... Aug 8 03:02:06.973388198 (17h22m6.562733185s) [upload=17992]: Upload finished. err: <nil> Aug 8 03:03:17.244757731 (17h23m16.834102718s) [upload=18011]: Starting upload Aug 8 03:03:17.244809900 (17h23m16.834154887s) [upload=18011]: Done starting upload Aug 8 03:03:17.244897138 (17h23m16.834242125s) [upload=18011]: Uploading segments... Aug 8 03:03:17.245001527 (17h23m16.834346514s) [upload=18011]: Got next segment. Inline: true Aug 8 03:03:17.245017979 (17h23m16.834362956s) [upload=18011]: Waiting for error group managing segments... Aug 8 03:03:17.245061272 (17h23m16.834406259s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:17.245066051 (17h23m16.834411038s) [upload=18011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:17.245068295 (17h23m16.834413282s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:17.537334768 (17h23m17.126679755s) [upload=18011]: Done uploading segments... Aug 8 03:03:17.537351780 (17h23m17.126696767s) [upload=18011]: Upload finished. err: <nil> Aug 8 03:03:52.908542382 (17h23m52.497887379s) [upload=18020]: Starting upload Aug 8 03:03:52.908632545 (17h23m52.497977562s) [upload=18020]: Done starting upload Aug 8 03:03:52.908719050 (17h23m52.498064108s) [upload=18020]: Uploading segments... Aug 8 03:03:52.908833700 (17h23m52.498178767s) [upload=18020]: Got next segment. Inline: true Aug 8 03:03:52.908840983 (17h23m52.49818604s) [upload=18020]: Waiting for error group managing segments... Aug 8 03:03:52.908894395 (17h23m52.498239393s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:52.908901379 (17h23m52.498246426s) [upload=18020]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:52.908907591 (17h23m52.498252648s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:53.211413265 (17h23m52.800758252s) [upload=18020]: Done uploading segments... Aug 8 03:03:53.211436890 (17h23m52.800781877s) [upload=18020]: Upload finished. err: <nil> Duration: 1.972496264s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X...........X.............................X.........] duration: 5.777119695s FAIL (2025-08-08 03:05:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 5.777136516s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.......X..............X..] duration: 1.836437192s FAIL (2025-08-08 03:05:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ne uploading segments... Aug 8 02:56:20.024202387 (17h16m19.613547374s) [upload=17888]: Upload finished. err: <nil> Aug 8 02:57:21.936712176 (17h17m21.526057163s) [upload=17907]: Starting upload Aug 8 02:57:21.936755830 (17h17m21.526100817s) [upload=17907]: Done starting upload Aug 8 02:57:21.936827617 (17h17m21.526172604s) [upload=17907]: Uploading segments... Aug 8 02:57:21.936859688 (17h17m21.526204685s) [upload=17907]: Got next segment. Inline: true Aug 8 02:57:21.936863435 (17h17m21.526208412s) [upload=17907]: Waiting for error group managing segments... Aug 8 02:57:21.936926376 (17h17m21.526271363s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:21.936930744 (17h17m21.526275732s) [upload=17907]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:21.936933590 (17h17m21.526278577s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:22.506444375 (17h17m22.095789373s) [upload=17907]: Done uploading segments... Aug 8 02:57:22.506475124 (17h17m22.095820101s) [upload=17907]: Upload finished. err: <nil> Aug 8 02:57:37.317930907 (17h17m36.907275904s) [upload=17911]: Starting upload Aug 8 02:57:37.317997885 (17h17m36.907342892s) [upload=17911]: Done starting upload Aug 8 02:57:37.318090021 (17h17m36.907435008s) [upload=17911]: Uploading segments... Aug 8 02:57:37.318259555 (17h17m36.907604562s) [upload=17911]: Got next segment. Inline: true Aug 8 02:57:37.318268222 (17h17m36.907613209s) [upload=17911]: Waiting for error group managing segments... Aug 8 02:57:37.318340520 (17h17m36.907685507s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:37.318346793 (17h17m36.90769178s) [upload=17911]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:37.318350209 (17h17m36.907695196s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:37.606185349 (17h17m37.195530326s) [upload=17911]: Done uploading segments... Aug 8 02:57:37.606203374 (17h17m37.195548361s) [upload=17911]: Upload finished. err: <nil> Aug 8 02:58:21.814121097 (17h18m21.403466084s) [upload=17922]: Starting upload Aug 8 02:58:21.814163258 (17h18m21.403508246s) [upload=17922]: Done starting upload Aug 8 02:58:21.814208725 (17h18m21.403553712s) [upload=17922]: Uploading segments... Aug 8 02:58:21.814237340 (17h18m21.403582327s) [upload=17922]: Got next segment. Inline: true Aug 8 02:58:21.814241047 (17h18m21.403586035s) [upload=17922]: Waiting for error group managing segments... Aug 8 02:58:21.814274962 (17h18m21.403619949s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:21.814278459 (17h18m21.403623446s) [upload=17922]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:21.814280823 (17h18m21.4036258s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:22.119464144 (17h18m21.708809131s) [upload=17922]: Done uploading segments... Aug 8 02:58:22.119486626 (17h18m21.708831654s) [upload=17922]: Upload finished. err: <nil> Aug 8 02:58:38.525992119 (17h18m38.115337106s) [upload=17925]: Starting upload Aug 8 02:58:38.526039660 (17h18m38.115384637s) [upload=17925]: Done starting upload Aug 8 02:58:38.526083594 (17h18m38.115428581s) [upload=17925]: Uploading segments... Aug 8 02:58:38.526113942 (17h18m38.115458919s) [upload=17925]: Got next segment. Inline: true Aug 8 02:58:38.526117620 (17h18m38.115462607s) [upload=17925]: Waiting for error group managing segments... Aug 8 02:58:38.526148008 (17h18m38.115492995s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:38.526151975 (17h18m38.115496962s) [upload=17925]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:38.526154329 (17h18m38.115499317s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:38.814559291 (17h18m38.403904268s) [upload=17925]: Done uploading segments... Aug 8 02:58:38.814575763 (17h18m38.40392075s) [upload=17925]: Upload finished. err: <nil> Aug 8 02:59:50.786538839 (17h19m50.375883826s) [upload=17947]: Starting upload Aug 8 02:59:50.786576711 (17h19m50.375921698s) [upload=17947]: Done starting upload Aug 8 02:59:50.786634171 (17h19m50.375979158s) [upload=17947]: Uploading segments... Aug 8 02:59:50.786663447 (17h19m50.376008434s) [upload=17947]: Got next segment. Inline: true Aug 8 02:59:50.786667324 (17h19m50.376012311s) [upload=17947]: Waiting for error group managing segments... Aug 8 02:59:50.786704085 (17h19m50.376049072s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:50.786707762 (17h19m50.376052749s) [upload=17947]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:50.786710096 (17h19m50.376055073s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:51.106334579 (17h19m50.695679556s) [upload=17947]: Done uploading segments... Aug 8 02:59:51.106377160 (17h19m50.695722147s) [upload=17947]: Upload finished. err: <nil> Aug 8 03:00:55.579919358 (17h20m55.169264345s) [upload=17972]: Starting upload Aug 8 03:00:55.579968011 (17h20m55.169312998s) [upload=17972]: Done starting upload Aug 8 03:00:55.580038948 (17h20m55.169383935s) [upload=17972]: Uploading segments... Aug 8 03:00:55.580135742 (17h20m55.169480729s) [upload=17972]: Got next segment. Inline: true Aug 8 03:00:55.580140883 (17h20m55.16948587s) [upload=17972]: Waiting for error group managing segments... Aug 8 03:00:55.580195307 (17h20m55.169540294s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:55.580200797 (17h20m55.169545784s) [upload=17972]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:55.580203292 (17h20m55.169548279s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:55.912085837 (17h20m55.501430824s) [upload=17972]: Done uploading segments... Aug 8 03:00:55.912105655 (17h20m55.501450642s) [upload=17972]: Upload finished. err: <nil> Aug 8 03:01:11.133547907 (17h21m10.722892884s) [upload=17973]: Starting upload Aug 8 03:01:11.133591461 (17h21m10.722936448s) [upload=17973]: Done starting upload Aug 8 03:01:11.133640935 (17h21m10.722985922s) [upload=17973]: Uploading segments... Aug 8 03:01:11.133672034 (17h21m10.723017021s) [upload=17973]: Got next segment. Inline: true Aug 8 03:01:11.133676524 (17h21m10.723021511s) [upload=17973]: Waiting for error group managing segments... Aug 8 03:01:11.133708765 (17h21m10.723053752s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:01:11.133712672 (17h21m10.723057659s) [upload=17973]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:11.133715087 (17h21m10.723060074s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:01:11.449374683 (17h21m11.03871967s) [upload=17973]: Done uploading segments... Aug 8 03:01:11.449394041 (17h21m11.038739028s) [upload=17973]: Upload finished. err: <nil> Aug 8 03:02:06.650900829 (17h22m6.240245806s) [upload=17992]: Starting upload Aug 8 03:02:06.650935946 (17h22m6.240280933s) [upload=17992]: Done starting upload Aug 8 03:02:06.650995931 (17h22m6.240340908s) [upload=17992]: Uploading segments... Aug 8 03:02:06.651029084 (17h22m6.240374071s) [upload=17992]: Got next segment. Inline: true Aug 8 03:02:06.651032301 (17h22m6.240377288s) [upload=17992]: Waiting for error group managing segments... Aug 8 03:02:06.651062359 (17h22m6.240407346s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:02:06.651065955 (17h22m6.240410942s) [upload=17992]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:06.651068059 (17h22m6.240413046s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:02:06.973370836 (17h22m6.562715823s) [upload=17992]: Done uploading segments... Aug 8 03:02:06.973388198 (17h22m6.562733185s) [upload=17992]: Upload finished. err: <nil> Aug 8 03:03:17.244757731 (17h23m16.834102718s) [upload=18011]: Starting upload Aug 8 03:03:17.244809900 (17h23m16.834154887s) [upload=18011]: Done starting upload Aug 8 03:03:17.244897138 (17h23m16.834242125s) [upload=18011]: Uploading segments... Aug 8 03:03:17.245001527 (17h23m16.834346514s) [upload=18011]: Got next segment. Inline: true Aug 8 03:03:17.245017979 (17h23m16.834362956s) [upload=18011]: Waiting for error group managing segments... Aug 8 03:03:17.245061272 (17h23m16.834406259s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:17.245066051 (17h23m16.834411038s) [upload=18011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:17.245068295 (17h23m16.834413282s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:17.537334768 (17h23m17.126679755s) [upload=18011]: Done uploading segments... Aug 8 03:03:17.537351780 (17h23m17.126696767s) [upload=18011]: Upload finished. err: <nil> Aug 8 03:03:52.908542382 (17h23m52.497887379s) [upload=18020]: Starting upload Aug 8 03:03:52.908632545 (17h23m52.497977562s) [upload=18020]: Done starting upload Aug 8 03:03:52.908719050 (17h23m52.498064108s) [upload=18020]: Uploading segments... Aug 8 03:03:52.908833700 (17h23m52.498178767s) [upload=18020]: Got next segment. Inline: true Aug 8 03:03:52.908840983 (17h23m52.49818604s) [upload=18020]: Waiting for error group managing segments... Aug 8 03:03:52.908894395 (17h23m52.498239393s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:52.908901379 (17h23m52.498246426s) [upload=18020]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:52.908907591 (17h23m52.498252648s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:53.211413265 (17h23m52.800758252s) [upload=18020]: Done uploading segments... Aug 8 03:03:53.211436890 (17h23m52.800781877s) [upload=18020]: Upload finished. err: <nil> Duration: 1.83647238s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X...........X.............................X........] duration: 5.628006043s FAIL (2025-08-08 03:05:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 5.628024758s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.......X..............X.] duration: 1.869672289s FAIL (2025-08-08 03:04:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ne uploading segments... Aug 8 02:56:20.024202387 (17h16m19.613547374s) [upload=17888]: Upload finished. err: <nil> Aug 8 02:57:21.936712176 (17h17m21.526057163s) [upload=17907]: Starting upload Aug 8 02:57:21.936755830 (17h17m21.526100817s) [upload=17907]: Done starting upload Aug 8 02:57:21.936827617 (17h17m21.526172604s) [upload=17907]: Uploading segments... Aug 8 02:57:21.936859688 (17h17m21.526204685s) [upload=17907]: Got next segment. Inline: true Aug 8 02:57:21.936863435 (17h17m21.526208412s) [upload=17907]: Waiting for error group managing segments... Aug 8 02:57:21.936926376 (17h17m21.526271363s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:21.936930744 (17h17m21.526275732s) [upload=17907]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:21.936933590 (17h17m21.526278577s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:22.506444375 (17h17m22.095789373s) [upload=17907]: Done uploading segments... Aug 8 02:57:22.506475124 (17h17m22.095820101s) [upload=17907]: Upload finished. err: <nil> Aug 8 02:57:37.317930907 (17h17m36.907275904s) [upload=17911]: Starting upload Aug 8 02:57:37.317997885 (17h17m36.907342892s) [upload=17911]: Done starting upload Aug 8 02:57:37.318090021 (17h17m36.907435008s) [upload=17911]: Uploading segments... Aug 8 02:57:37.318259555 (17h17m36.907604562s) [upload=17911]: Got next segment. Inline: true Aug 8 02:57:37.318268222 (17h17m36.907613209s) [upload=17911]: Waiting for error group managing segments... Aug 8 02:57:37.318340520 (17h17m36.907685507s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:37.318346793 (17h17m36.90769178s) [upload=17911]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:37.318350209 (17h17m36.907695196s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:37.606185349 (17h17m37.195530326s) [upload=17911]: Done uploading segments... Aug 8 02:57:37.606203374 (17h17m37.195548361s) [upload=17911]: Upload finished. err: <nil> Aug 8 02:58:21.814121097 (17h18m21.403466084s) [upload=17922]: Starting upload Aug 8 02:58:21.814163258 (17h18m21.403508246s) [upload=17922]: Done starting upload Aug 8 02:58:21.814208725 (17h18m21.403553712s) [upload=17922]: Uploading segments... Aug 8 02:58:21.814237340 (17h18m21.403582327s) [upload=17922]: Got next segment. Inline: true Aug 8 02:58:21.814241047 (17h18m21.403586035s) [upload=17922]: Waiting for error group managing segments... Aug 8 02:58:21.814274962 (17h18m21.403619949s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:21.814278459 (17h18m21.403623446s) [upload=17922]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:21.814280823 (17h18m21.4036258s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:22.119464144 (17h18m21.708809131s) [upload=17922]: Done uploading segments... Aug 8 02:58:22.119486626 (17h18m21.708831654s) [upload=17922]: Upload finished. err: <nil> Aug 8 02:58:38.525992119 (17h18m38.115337106s) [upload=17925]: Starting upload Aug 8 02:58:38.526039660 (17h18m38.115384637s) [upload=17925]: Done starting upload Aug 8 02:58:38.526083594 (17h18m38.115428581s) [upload=17925]: Uploading segments... Aug 8 02:58:38.526113942 (17h18m38.115458919s) [upload=17925]: Got next segment. Inline: true Aug 8 02:58:38.526117620 (17h18m38.115462607s) [upload=17925]: Waiting for error group managing segments... Aug 8 02:58:38.526148008 (17h18m38.115492995s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:38.526151975 (17h18m38.115496962s) [upload=17925]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:38.526154329 (17h18m38.115499317s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:38.814559291 (17h18m38.403904268s) [upload=17925]: Done uploading segments... Aug 8 02:58:38.814575763 (17h18m38.40392075s) [upload=17925]: Upload finished. err: <nil> Aug 8 02:59:50.786538839 (17h19m50.375883826s) [upload=17947]: Starting upload Aug 8 02:59:50.786576711 (17h19m50.375921698s) [upload=17947]: Done starting upload Aug 8 02:59:50.786634171 (17h19m50.375979158s) [upload=17947]: Uploading segments... Aug 8 02:59:50.786663447 (17h19m50.376008434s) [upload=17947]: Got next segment. Inline: true Aug 8 02:59:50.786667324 (17h19m50.376012311s) [upload=17947]: Waiting for error group managing segments... Aug 8 02:59:50.786704085 (17h19m50.376049072s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:50.786707762 (17h19m50.376052749s) [upload=17947]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:50.786710096 (17h19m50.376055073s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:51.106334579 (17h19m50.695679556s) [upload=17947]: Done uploading segments... Aug 8 02:59:51.106377160 (17h19m50.695722147s) [upload=17947]: Upload finished. err: <nil> Aug 8 03:00:55.579919358 (17h20m55.169264345s) [upload=17972]: Starting upload Aug 8 03:00:55.579968011 (17h20m55.169312998s) [upload=17972]: Done starting upload Aug 8 03:00:55.580038948 (17h20m55.169383935s) [upload=17972]: Uploading segments... Aug 8 03:00:55.580135742 (17h20m55.169480729s) [upload=17972]: Got next segment. Inline: true Aug 8 03:00:55.580140883 (17h20m55.16948587s) [upload=17972]: Waiting for error group managing segments... Aug 8 03:00:55.580195307 (17h20m55.169540294s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:55.580200797 (17h20m55.169545784s) [upload=17972]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:55.580203292 (17h20m55.169548279s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:55.912085837 (17h20m55.501430824s) [upload=17972]: Done uploading segments... Aug 8 03:00:55.912105655 (17h20m55.501450642s) [upload=17972]: Upload finished. err: <nil> Aug 8 03:01:11.133547907 (17h21m10.722892884s) [upload=17973]: Starting upload Aug 8 03:01:11.133591461 (17h21m10.722936448s) [upload=17973]: Done starting upload Aug 8 03:01:11.133640935 (17h21m10.722985922s) [upload=17973]: Uploading segments... Aug 8 03:01:11.133672034 (17h21m10.723017021s) [upload=17973]: Got next segment. Inline: true Aug 8 03:01:11.133676524 (17h21m10.723021511s) [upload=17973]: Waiting for error group managing segments... Aug 8 03:01:11.133708765 (17h21m10.723053752s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:01:11.133712672 (17h21m10.723057659s) [upload=17973]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:11.133715087 (17h21m10.723060074s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:01:11.449374683 (17h21m11.03871967s) [upload=17973]: Done uploading segments... Aug 8 03:01:11.449394041 (17h21m11.038739028s) [upload=17973]: Upload finished. err: <nil> Aug 8 03:02:06.650900829 (17h22m6.240245806s) [upload=17992]: Starting upload Aug 8 03:02:06.650935946 (17h22m6.240280933s) [upload=17992]: Done starting upload Aug 8 03:02:06.650995931 (17h22m6.240340908s) [upload=17992]: Uploading segments... Aug 8 03:02:06.651029084 (17h22m6.240374071s) [upload=17992]: Got next segment. Inline: true Aug 8 03:02:06.651032301 (17h22m6.240377288s) [upload=17992]: Waiting for error group managing segments... Aug 8 03:02:06.651062359 (17h22m6.240407346s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:02:06.651065955 (17h22m6.240410942s) [upload=17992]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:06.651068059 (17h22m6.240413046s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:02:06.973370836 (17h22m6.562715823s) [upload=17992]: Done uploading segments... Aug 8 03:02:06.973388198 (17h22m6.562733185s) [upload=17992]: Upload finished. err: <nil> Aug 8 03:03:17.244757731 (17h23m16.834102718s) [upload=18011]: Starting upload Aug 8 03:03:17.244809900 (17h23m16.834154887s) [upload=18011]: Done starting upload Aug 8 03:03:17.244897138 (17h23m16.834242125s) [upload=18011]: Uploading segments... Aug 8 03:03:17.245001527 (17h23m16.834346514s) [upload=18011]: Got next segment. Inline: true Aug 8 03:03:17.245017979 (17h23m16.834362956s) [upload=18011]: Waiting for error group managing segments... Aug 8 03:03:17.245061272 (17h23m16.834406259s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:17.245066051 (17h23m16.834411038s) [upload=18011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:17.245068295 (17h23m16.834413282s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:17.537334768 (17h23m17.126679755s) [upload=18011]: Done uploading segments... Aug 8 03:03:17.537351780 (17h23m17.126696767s) [upload=18011]: Upload finished. err: <nil> Aug 8 03:03:52.908542382 (17h23m52.497887379s) [upload=18020]: Starting upload Aug 8 03:03:52.908632545 (17h23m52.497977562s) [upload=18020]: Done starting upload Aug 8 03:03:52.908719050 (17h23m52.498064108s) [upload=18020]: Uploading segments... Aug 8 03:03:52.908833700 (17h23m52.498178767s) [upload=18020]: Got next segment. Inline: true Aug 8 03:03:52.908840983 (17h23m52.49818604s) [upload=18020]: Waiting for error group managing segments... Aug 8 03:03:52.908894395 (17h23m52.498239393s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:52.908901379 (17h23m52.498246426s) [upload=18020]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:52.908907591 (17h23m52.498252648s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:53.211413265 (17h23m52.800758252s) [upload=18020]: Done uploading segments... Aug 8 03:03:53.211436890 (17h23m52.800781877s) [upload=18020]: Upload finished. err: <nil> Duration: 1.869699281s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X...........X.............................X.......] duration: 5.634716994s FAIL (2025-08-08 03:04:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 5.634740989s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.......X..............X] duration: 1.410416599s FAIL (2025-08-08 03:03:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== ne uploading segments... Aug 8 02:56:20.024202387 (17h16m19.613547374s) [upload=17888]: Upload finished. err: <nil> Aug 8 02:57:21.936712176 (17h17m21.526057163s) [upload=17907]: Starting upload Aug 8 02:57:21.936755830 (17h17m21.526100817s) [upload=17907]: Done starting upload Aug 8 02:57:21.936827617 (17h17m21.526172604s) [upload=17907]: Uploading segments... Aug 8 02:57:21.936859688 (17h17m21.526204685s) [upload=17907]: Got next segment. Inline: true Aug 8 02:57:21.936863435 (17h17m21.526208412s) [upload=17907]: Waiting for error group managing segments... Aug 8 02:57:21.936926376 (17h17m21.526271363s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:21.936930744 (17h17m21.526275732s) [upload=17907]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:21.936933590 (17h17m21.526278577s) [upload=17907]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:22.506444375 (17h17m22.095789373s) [upload=17907]: Done uploading segments... Aug 8 02:57:22.506475124 (17h17m22.095820101s) [upload=17907]: Upload finished. err: <nil> Aug 8 02:57:37.317930907 (17h17m36.907275904s) [upload=17911]: Starting upload Aug 8 02:57:37.317997885 (17h17m36.907342892s) [upload=17911]: Done starting upload Aug 8 02:57:37.318090021 (17h17m36.907435008s) [upload=17911]: Uploading segments... Aug 8 02:57:37.318259555 (17h17m36.907604562s) [upload=17911]: Got next segment. Inline: true Aug 8 02:57:37.318268222 (17h17m36.907613209s) [upload=17911]: Waiting for error group managing segments... Aug 8 02:57:37.318340520 (17h17m36.907685507s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:57:37.318346793 (17h17m36.90769178s) [upload=17911]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:37.318350209 (17h17m36.907695196s) [upload=17911]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:57:37.606185349 (17h17m37.195530326s) [upload=17911]: Done uploading segments... Aug 8 02:57:37.606203374 (17h17m37.195548361s) [upload=17911]: Upload finished. err: <nil> Aug 8 02:58:21.814121097 (17h18m21.403466084s) [upload=17922]: Starting upload Aug 8 02:58:21.814163258 (17h18m21.403508246s) [upload=17922]: Done starting upload Aug 8 02:58:21.814208725 (17h18m21.403553712s) [upload=17922]: Uploading segments... Aug 8 02:58:21.814237340 (17h18m21.403582327s) [upload=17922]: Got next segment. Inline: true Aug 8 02:58:21.814241047 (17h18m21.403586035s) [upload=17922]: Waiting for error group managing segments... Aug 8 02:58:21.814274962 (17h18m21.403619949s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:21.814278459 (17h18m21.403623446s) [upload=17922]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:21.814280823 (17h18m21.4036258s) [upload=17922]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:22.119464144 (17h18m21.708809131s) [upload=17922]: Done uploading segments... Aug 8 02:58:22.119486626 (17h18m21.708831654s) [upload=17922]: Upload finished. err: <nil> Aug 8 02:58:38.525992119 (17h18m38.115337106s) [upload=17925]: Starting upload Aug 8 02:58:38.526039660 (17h18m38.115384637s) [upload=17925]: Done starting upload Aug 8 02:58:38.526083594 (17h18m38.115428581s) [upload=17925]: Uploading segments... Aug 8 02:58:38.526113942 (17h18m38.115458919s) [upload=17925]: Got next segment. Inline: true Aug 8 02:58:38.526117620 (17h18m38.115462607s) [upload=17925]: Waiting for error group managing segments... Aug 8 02:58:38.526148008 (17h18m38.115492995s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:58:38.526151975 (17h18m38.115496962s) [upload=17925]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:38.526154329 (17h18m38.115499317s) [upload=17925]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:58:38.814559291 (17h18m38.403904268s) [upload=17925]: Done uploading segments... Aug 8 02:58:38.814575763 (17h18m38.40392075s) [upload=17925]: Upload finished. err: <nil> Aug 8 02:59:50.786538839 (17h19m50.375883826s) [upload=17947]: Starting upload Aug 8 02:59:50.786576711 (17h19m50.375921698s) [upload=17947]: Done starting upload Aug 8 02:59:50.786634171 (17h19m50.375979158s) [upload=17947]: Uploading segments... Aug 8 02:59:50.786663447 (17h19m50.376008434s) [upload=17947]: Got next segment. Inline: true Aug 8 02:59:50.786667324 (17h19m50.376012311s) [upload=17947]: Waiting for error group managing segments... Aug 8 02:59:50.786704085 (17h19m50.376049072s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:50.786707762 (17h19m50.376052749s) [upload=17947]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:50.786710096 (17h19m50.376055073s) [upload=17947]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:51.106334579 (17h19m50.695679556s) [upload=17947]: Done uploading segments... Aug 8 02:59:51.106377160 (17h19m50.695722147s) [upload=17947]: Upload finished. err: <nil> Aug 8 03:00:55.579919358 (17h20m55.169264345s) [upload=17972]: Starting upload Aug 8 03:00:55.579968011 (17h20m55.169312998s) [upload=17972]: Done starting upload Aug 8 03:00:55.580038948 (17h20m55.169383935s) [upload=17972]: Uploading segments... Aug 8 03:00:55.580135742 (17h20m55.169480729s) [upload=17972]: Got next segment. Inline: true Aug 8 03:00:55.580140883 (17h20m55.16948587s) [upload=17972]: Waiting for error group managing segments... Aug 8 03:00:55.580195307 (17h20m55.169540294s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:00:55.580200797 (17h20m55.169545784s) [upload=17972]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:55.580203292 (17h20m55.169548279s) [upload=17972]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:00:55.912085837 (17h20m55.501430824s) [upload=17972]: Done uploading segments... Aug 8 03:00:55.912105655 (17h20m55.501450642s) [upload=17972]: Upload finished. err: <nil> Aug 8 03:01:11.133547907 (17h21m10.722892884s) [upload=17973]: Starting upload Aug 8 03:01:11.133591461 (17h21m10.722936448s) [upload=17973]: Done starting upload Aug 8 03:01:11.133640935 (17h21m10.722985922s) [upload=17973]: Uploading segments... Aug 8 03:01:11.133672034 (17h21m10.723017021s) [upload=17973]: Got next segment. Inline: true Aug 8 03:01:11.133676524 (17h21m10.723021511s) [upload=17973]: Waiting for error group managing segments... Aug 8 03:01:11.133708765 (17h21m10.723053752s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:01:11.133712672 (17h21m10.723057659s) [upload=17973]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:11.133715087 (17h21m10.723060074s) [upload=17973]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:01:11.449374683 (17h21m11.03871967s) [upload=17973]: Done uploading segments... Aug 8 03:01:11.449394041 (17h21m11.038739028s) [upload=17973]: Upload finished. err: <nil> Aug 8 03:02:06.650900829 (17h22m6.240245806s) [upload=17992]: Starting upload Aug 8 03:02:06.650935946 (17h22m6.240280933s) [upload=17992]: Done starting upload Aug 8 03:02:06.650995931 (17h22m6.240340908s) [upload=17992]: Uploading segments... Aug 8 03:02:06.651029084 (17h22m6.240374071s) [upload=17992]: Got next segment. Inline: true Aug 8 03:02:06.651032301 (17h22m6.240377288s) [upload=17992]: Waiting for error group managing segments... Aug 8 03:02:06.651062359 (17h22m6.240407346s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:02:06.651065955 (17h22m6.240410942s) [upload=17992]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:06.651068059 (17h22m6.240413046s) [upload=17992]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:02:06.973370836 (17h22m6.562715823s) [upload=17992]: Done uploading segments... Aug 8 03:02:06.973388198 (17h22m6.562733185s) [upload=17992]: Upload finished. err: <nil> Aug 8 03:03:17.244757731 (17h23m16.834102718s) [upload=18011]: Starting upload Aug 8 03:03:17.244809900 (17h23m16.834154887s) [upload=18011]: Done starting upload Aug 8 03:03:17.244897138 (17h23m16.834242125s) [upload=18011]: Uploading segments... Aug 8 03:03:17.245001527 (17h23m16.834346514s) [upload=18011]: Got next segment. Inline: true Aug 8 03:03:17.245017979 (17h23m16.834362956s) [upload=18011]: Waiting for error group managing segments... Aug 8 03:03:17.245061272 (17h23m16.834406259s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:17.245066051 (17h23m16.834411038s) [upload=18011]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:17.245068295 (17h23m16.834413282s) [upload=18011]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:17.537334768 (17h23m17.126679755s) [upload=18011]: Done uploading segments... Aug 8 03:03:17.537351780 (17h23m17.126696767s) [upload=18011]: Upload finished. err: <nil> Aug 8 03:03:52.908542382 (17h23m52.497887379s) [upload=18020]: Starting upload Aug 8 03:03:52.908632545 (17h23m52.497977562s) [upload=18020]: Done starting upload Aug 8 03:03:52.908719050 (17h23m52.498064108s) [upload=18020]: Uploading segments... Aug 8 03:03:52.908833700 (17h23m52.498178767s) [upload=18020]: Got next segment. Inline: true Aug 8 03:03:52.908840983 (17h23m52.49818604s) [upload=18020]: Waiting for error group managing segments... Aug 8 03:03:52.908894395 (17h23m52.498239393s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:03:52.908901379 (17h23m52.498246426s) [upload=18020]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:03:52.908907591 (17h23m52.498252648s) [upload=18020]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:03:53.211413265 (17h23m52.800758252s) [upload=18020]: Done uploading segments... Aug 8 03:03:53.211436890 (17h23m52.800781877s) [upload=18020]: Upload finished. err: <nil> Duration: 1.410445584s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X...........X.............................X......] duration: 5.530740738s FAIL (2025-08-08 03:03:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 5.53076185s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X...........X.............................X.....] duration: 5.707620161s FAIL (2025-08-08 03:03:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 5.707660539s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.......X..............] duration: 1.888431986s FAIL (2025-08-08 03:03:18 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.888462995s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X...........X.............................X....] duration: 5.747823198s FAIL (2025-08-08 03:02:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 5.747848086s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.......X.............] duration: 1.973944813s FAIL (2025-08-08 03:02:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.974012702s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X...........X.............................X...] duration: 5.610872445s FAIL (2025-08-08 03:01:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 5.610889998s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.......X............] duration: 1.927405842s FAIL (2025-08-08 03:01:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.927429778s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.......X...........] duration: 1.957520811s FAIL (2025-08-08 03:00:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.957547763s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X...........X.............................X..] duration: 6.77618145s FAIL (2025-08-08 03:00:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 6.776210946s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X...........X.............................X.] duration: 5.72266141s FAIL (2025-08-08 03:00:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 5.722686377s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.......X..........] duration: 1.962758344s FAIL (2025-08-08 02:59:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.962785987s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X...........X.............................X] duration: 854.592417ms FAIL (2025-08-08 02:59:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 15 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858243662 (17h19m16.447588659s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.858682431 (17h19m16.448027408s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859066777 (17h19m16.448411764s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859090382 (17h19m16.448435359s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859422467 (17h19m16.448767454s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859464688 (17h19m16.448809675s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859746416 (17h19m16.449091393s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.859780643 (17h19m16.44912563s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860066429 (17h19m16.449411416s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860109561 (17h19m16.449454548s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860347567 (17h19m16.449692554s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860387313 (17h19m16.4497323s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860572707 (17h19m16.449917694s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860636510 (17h19m16.449981497s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860865748 (17h19m16.450210735s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.860924480 (17h19m16.450269468s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:16.861113102 (17h19m16.450458089s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Uploading piece... Aug 8 02:59:17.987666487 (17h19m17.577011474s) [upload=17939]: Next returned nil segment Aug 8 02:59:17.987678810 (17h19m17.577023787s) [upload=17939]: Waiting for error group managing segments... Aug 8 02:59:18.321106692 (17h19m17.910451679s) [noise=true , address=64.49.13.138:4490 , piece_id=JR3CJH2BGXTD6G253BIQWF5I3EN3E3UXEX7TWXV7SBXESY7VCG2A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.329160801 (17h19m17.918505788s) [noise=true , address=64.49.13.137:4500 , piece_id=5M6ZX6K23PXUYINAXRMYNQ575CGJSPCTMTOBHDIZI5LVJ7MN2GVQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.774172384 (17h19m18.363517372s) [noise=true , address=79.127.219.48:4103 , piece_id=RYKVOUQAQNMMGCTCFL6EHZ24ER4VFSPSGHKJQ6DLJL4QZNQNJ4WA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776429604 (17h19m18.365774601s) [noise=true , address=104.36.82.23:4462 , piece_id=CKBMSYBZEPTZ47D7VXVXBEQCSC466ZUTP35V5GOPVNXX4754OHUA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.776747171 (17h19m18.366092158s) [noise=true , address=104.36.82.43:4857 , piece_id=TXTVFT5I2LL2NHHUW5FUN7SJG6T7C5VD4TJHZZD7XQ2VXPNTDR7A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.806574319 (17h19m18.395919306s) [noise=true , address=79.127.201.215:4345 , piece_id=OCJINQQYCAPPD7PJ6D7BKILHLXHDWDGVWREOCYIAK5ZTVMBJBRNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.840883902 (17h19m18.430228889s) [noise=true , address=104.36.82.34:4546 , piece_id=35MNFTCGTH6HVSFR2S6YBCFTC4F4DIFBWHKQFWBQYQMPIDHMVBTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.848861215 (17h19m18.438206202s) [noise=true , address=45.91.116.7:4015 , piece_id=U6KJ4ZDGFKM6UDR2EAAE3VFHCWKXABAD3T7CW4GGBUY7SUU3QKQA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.850932018 (17h19m18.440276995s) [noise=true , address=104.36.82.52:4094 , piece_id=X6Z3IUC2DZYT6HXXDCWIJ2ISN7XZ7VGSNY2YAXHKW5PV3OJMZHJQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.851342083 (17h19m18.44068707s) [noise=true , address=104.36.82.37:4686 , piece_id=V7GVVZETRYA7ONEZSPSPYFG2K7N7R2PM5QMVFV5OCKFLCVAJE6KA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859061622 (17h19m18.448406609s) [noise=true , address=104.36.82.58:4267 , piece_id=ZEUTWBSF6OW7GWPRDBV5OPACQVSYFLXSGMZ2MJGDVSUXQJUJDKVA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.859172394 (17h19m18.448517381s) [noise=true , address=104.36.82.11:4132 , piece_id=QACNTI6NTXHM66C3SZI4LACWFTIIQ6MTUMTT3SG3BV6IVJBEI25A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.870642469 (17h19m18.459987446s) [noise=true , address=104.36.82.39:4728 , piece_id=H7NEUNY6Z2LNSZCJGAE2GKXJ3DDY3QZUNDZWB3CD4UM33JFXNDTA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920892562 (17h19m18.510237549s) [noise=true , address=104.36.82.46:4501 , piece_id=L5D3Y7PJ4MJZSSDDYRFNVREHXUJKGIH2YNI22WO7XGRKBDL4DQ4A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: <nil> Aug 8 02:59:18.920917119 (17h19m18.510262106s) [seg_pos={0 0}, upload=17939]: Segment reached optimal threshold of 14 pieces. Aug 8 02:59:18.921019926 (17h19m18.510364903s) [noise=true , address=104.36.82.47:4549 , piece_id=4TEM35NR3EUVGUM4OZ2KHLE6S2DB67OPZ5BXV2A3WMZYCUUJHZNA, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HWoyMKQ6v2XWUfEmfFh3m8AiGivAcYkkZ9na8kqHFzH2hPDeK): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921078248 (17h19m18.510423235s) [noise=true , address=104.36.82.14:4249 , piece_id=QJEIEWXSTJL4JVZVMZKVKZODZCY6P2OWJIK6NJVFNWPDAY4IJV3A, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GnfZTc54L9eRyjCUwQuaFcG6FjsUDjDwT3Gx4zoNTQrvP158L): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921129044 (17h19m18.510474031s) [noise=true , address=104.36.82.45:4908 , piece_id=6UBCK7FBIQYCHMQGQ2TKEWUDRWFXOC764IFLTM6JSCY73VRCGJ2Q, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qm73bcHkYSxHw4GGgnB8u1MPpCiQTVm9D35DFYrhrQf49M2y2): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921168220 (17h19m18.510513197s) [noise=true , address=45.91.116.11:4144 , piece_id=S3NWCXCLOJL5KE32XHUC2PA4KLZDMNY7Z4WUQDJSGYPCENWMLLAQ, seg_pos={0 0}, upload=17939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pVUbYqZ45XwL1okUwfeWoERLzHEv7Ne3dRMgmFvuxKXGktCiA): protocol: expected piece hash; context canceled; EOF Aug 8 02:59:18.921221782 (17h19m18.510566759s) [seg_pos={0 0}, upload=17939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:59:18.921299862 (17h19m18.510644839s) [upload=17939]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:59:18.921304190 (17h19m18.510649177s) [upload=17939]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:59:19.249199806 (17h19m18.838544793s) [upload=17939]: Done uploading segments... Aug 8 02:59:19.249219464 (17h19m18.838564451s) [upload=17939]: Upload finished. err: <nil> Aug 8 02:59:44.615168925 (17h19m44.204513912s) [upload=17945]: Starting upload Aug 8 02:59:44.615206507 (17h19m44.204551494s) [upload=17945]: Done starting upload Aug 8 02:59:44.615376041 (17h19m44.204721028s) [upload=17945]: Uploading segments... Aug 8 02:59:44.615421238 (17h19m44.204766235s) [upload=17945]: Got next segment. Inline: false Aug 8 02:59:44.615448129 (17h19m44.204793116s) [upload=17945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:59:44.615452137 (17h19m44.204797124s) [upload=17945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:59:44.827535864 (17h19m44.416880851s) [upload=17945]: Next segment err: metaclient: Too Many Requests Aug 8 02:59:44.827556344 (17h19m44.416901321s) [upload=17945]: Done uploading segments... Aug 8 02:59:44.827568657 (17h19m44.416913644s) [upload=17945]: Upload finished. err: metaclient: Too Many Requests Duration: 854.613928ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X...........X.............................] duration: 5.643346719s FAIL (2025-08-08 02:59:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.643366185s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X...........X............................] duration: 5.861561765s FAIL (2025-08-08 02:59:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.861581874s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.......X.........] duration: 1.861251189s FAIL (2025-08-08 02:58:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.861279934s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.......X........] duration: 1.952552534s FAIL (2025-08-08 02:58:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.952577032s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X...........X...........................] duration: 5.836729732s FAIL (2025-08-08 02:58:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.836748577s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.......X.......] duration: 1.882019487s FAIL (2025-08-08 02:57:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.882050195s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X.......X......] duration: 2.352477855s FAIL (2025-08-08 02:57:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 2.352505619s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...........X..........................] duration: 6.074576912s FAIL (2025-08-08 02:57:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 6.074600117s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X.............................................X.......X.....] duration: 1.835255804s FAIL (2025-08-08 02:56:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.835282395s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X...........X.........................] duration: 5.681035907s FAIL (2025-08-08 02:56:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.681060132s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X.............................................X.......X....] duration: 1.889408321s FAIL (2025-08-08 02:55:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.889437788s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...........X........................] duration: 5.734573178s FAIL (2025-08-08 02:55:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.734600751s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X.X.............................................X.......X...] duration: 1.850583419s FAIL (2025-08-08 02:55:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.850604439s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X...........X.......................] duration: 5.888748861s FAIL (2025-08-08 02:54:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.888773738s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.X.............................................X.......X..] duration: 1.862127095s FAIL (2025-08-08 02:54:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.862162412s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X........................X...........X......................] duration: 5.618770166s FAIL (2025-08-08 02:53:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.618797398s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X.X.............................................X.......X.] duration: 1.877966559s FAIL (2025-08-08 02:53:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.877991789s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X........................X...........X.....................] duration: 5.76244719s FAIL (2025-08-08 02:53:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.762473551s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X.X.............................................X.......X] duration: 1.471386468s FAIL (2025-08-08 02:52:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 7h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Aug 8 02:47:42.946969164 (17h7m42.536314151s) [upload=17738]: Starting upload Aug 8 02:47:42.947033166 (17h7m42.536378153s) [upload=17738]: Done starting upload Aug 8 02:47:42.947095775 (17h7m42.536440752s) [upload=17738]: Uploading segments... Aug 8 02:47:42.947135642 (17h7m42.536480629s) [upload=17738]: Got next segment. Inline: true Aug 8 02:47:42.947139169 (17h7m42.536484156s) [upload=17738]: Waiting for error group managing segments... Aug 8 02:47:42.947182441 (17h7m42.536527418s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:42.947186790 (17h7m42.536531777s) [upload=17738]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:42.947189165 (17h7m42.536534142s) [upload=17738]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:43.342311552 (17h7m42.931656539s) [upload=17738]: Done uploading segments... Aug 8 02:47:43.342333655 (17h7m42.931678672s) [upload=17738]: Upload finished. err: <nil> Aug 8 02:48:25.179014534 (17h8m24.768359521s) [upload=17752]: Starting upload Aug 8 02:48:25.179061383 (17h8m24.76840637s) [upload=17752]: Done starting upload Aug 8 02:48:25.179137418 (17h8m24.768482426s) [upload=17752]: Uploading segments... Aug 8 02:48:25.179181163 (17h8m24.76852618s) [upload=17752]: Got next segment. Inline: true Aug 8 02:48:25.179187424 (17h8m24.768532411s) [upload=17752]: Waiting for error group managing segments... Aug 8 02:48:25.179244273 (17h8m24.76858927s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:48:25.179252979 (17h8m24.768597966s) [upload=17752]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:48:25.179257648 (17h8m24.768602645s) [upload=17752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:48:25.733096679 (17h8m25.322441666s) [upload=17752]: Done uploading segments... Aug 8 02:48:25.733114974 (17h8m25.322459961s) [upload=17752]: Upload finished. err: <nil> Aug 8 02:49:00.878263944 (17h9m0.467608931s) [upload=17761]: Starting upload Aug 8 02:49:00.878312638 (17h9m0.467657625s) [upload=17761]: Done starting upload Aug 8 02:49:00.878366851 (17h9m0.467711839s) [upload=17761]: Uploading segments... Aug 8 02:49:00.878399414 (17h9m0.467744401s) [upload=17761]: Got next segment. Inline: true Aug 8 02:49:00.878403112 (17h9m0.467748089s) [upload=17761]: Waiting for error group managing segments... Aug 8 02:49:00.878434431 (17h9m0.467779408s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:00.878438038 (17h9m0.467783015s) [upload=17761]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:00.878440202 (17h9m0.467785179s) [upload=17761]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:01.281005624 (17h9m0.870350611s) [upload=17761]: Done uploading segments... Aug 8 02:49:01.281023068 (17h9m0.870368055s) [upload=17761]: Upload finished. err: <nil> Aug 8 02:49:21.971656885 (17h9m21.561001872s) [upload=17767]: Starting upload Aug 8 02:49:21.971702902 (17h9m21.561047879s) [upload=17767]: Done starting upload Aug 8 02:49:21.971788696 (17h9m21.561133683s) [upload=17767]: Uploading segments... Aug 8 02:49:21.971870974 (17h9m21.561215961s) [upload=17767]: Got next segment. Inline: true Aug 8 02:49:21.971876645 (17h9m21.561221632s) [upload=17767]: Waiting for error group managing segments... Aug 8 02:49:21.971917062 (17h9m21.561262049s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:49:21.971922042 (17h9m21.561267029s) [upload=17767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:49:21.971924366 (17h9m21.561269353s) [upload=17767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:49:22.320803500 (17h9m21.910148487s) [upload=17767]: Done uploading segments... Aug 8 02:49:22.320821455 (17h9m21.910166432s) [upload=17767]: Upload finished. err: <nil> Aug 8 02:50:18.674514437 (17h10m18.263859424s) [upload=17784]: Starting upload Aug 8 02:50:18.674567278 (17h10m18.263912265s) [upload=17784]: Done starting upload Aug 8 02:50:18.674639866 (17h10m18.263984853s) [upload=17784]: Uploading segments... Aug 8 02:50:18.674693599 (17h10m18.264038576s) [upload=17784]: Got next segment. Inline: true Aug 8 02:50:18.674698889 (17h10m18.264043876s) [upload=17784]: Waiting for error group managing segments... Aug 8 02:50:18.674743695 (17h10m18.264088692s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:50:18.674750889 (17h10m18.264095896s) [upload=17784]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:50:18.674755719 (17h10m18.264100706s) [upload=17784]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:50:18.972844576 (17h10m18.562189553s) [upload=17784]: Done uploading segments... Aug 8 02:50:18.972865216 (17h10m18.562210203s) [upload=17784]: Upload finished. err: <nil> Aug 8 02:51:16.006473342 (17h11m15.595818329s) [upload=17800]: Starting upload Aug 8 02:51:16.006522235 (17h11m15.595867212s) [upload=17800]: Done starting upload Aug 8 02:51:16.006589274 (17h11m15.595934261s) [upload=17800]: Uploading segments... Aug 8 02:51:16.006676250 (17h11m15.596021237s) [upload=17800]: Got next segment. Inline: true Aug 8 02:51:16.006681330 (17h11m15.596026307s) [upload=17800]: Waiting for error group managing segments... Aug 8 02:51:16.006735163 (17h11m15.59608014s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:51:16.006740072 (17h11m15.596085059s) [upload=17800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:51:16.006742526 (17h11m15.596087503s) [upload=17800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:51:16.287444558 (17h11m15.876789545s) [upload=17800]: Done uploading segments... Aug 8 02:51:16.287464786 (17h11m15.876809763s) [upload=17800]: Upload finished. err: <nil> Aug 8 02:52:22.730949368 (17h12m22.320294355s) [upload=17820]: Starting upload Aug 8 02:52:22.731010134 (17h12m22.320355131s) [upload=17820]: Done starting upload Aug 8 02:52:22.731073406 (17h12m22.320418393s) [upload=17820]: Uploading segments... Aug 8 02:52:22.731115215 (17h12m22.320460203s) [upload=17820]: Got next segment. Inline: true Aug 8 02:52:22.731119453 (17h12m22.32046444s) [upload=17820]: Waiting for error group managing segments... Aug 8 02:52:22.731173757 (17h12m22.320518754s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:22.731183386 (17h12m22.320528393s) [upload=17820]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:22.731188506 (17h12m22.320533543s) [upload=17820]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:23.040311244 (17h12m22.629656231s) [upload=17820]: Done uploading segments... Aug 8 02:52:23.040330702 (17h12m22.629675689s) [upload=17820]: Upload finished. err: <nil> Aug 8 02:52:49.345627205 (17h12m48.934972192s) [upload=17826]: Starting upload Aug 8 02:52:49.345673283 (17h12m48.93501826s) [upload=17826]: Done starting upload Aug 8 02:52:49.345722267 (17h12m48.935067254s) [upload=17826]: Uploading segments... Aug 8 02:52:49.345751232 (17h12m48.935096229s) [upload=17826]: Got next segment. Inline: true Aug 8 02:52:49.345755951 (17h12m48.935100938s) [upload=17826]: Waiting for error group managing segments... Aug 8 02:52:49.345790488 (17h12m48.935135465s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:52:49.345812569 (17h12m48.935157556s) [upload=17826]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:52:49.345815194 (17h12m48.935160181s) [upload=17826]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:52:49.666814657 (17h12m49.256159644s) [upload=17826]: Done uploading segments... Aug 8 02:52:49.666832671 (17h12m49.256177658s) [upload=17826]: Upload finished. err: <nil> Duration: 1.471411717s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X.X.............................................X.......] duration: 1.883213828s FAIL (2025-08-08 02:52:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== em_ObjectCommit Aug 8 02:40:22.693731298 (17h0m22.283076285s) [upload=17615]: Done uploading segments... Aug 8 02:40:22.693748982 (17h0m22.283093969s) [upload=17615]: Upload finished. err: <nil> Aug 8 02:40:50.891334842 (17h0m50.480679829s) [upload=17623]: Starting upload Aug 8 02:40:50.891373465 (17h0m50.480718452s) [upload=17623]: Done starting upload Aug 8 02:40:50.891420756 (17h0m50.480765743s) [upload=17623]: Uploading segments... Aug 8 02:40:50.891445724 (17h0m50.480790711s) [upload=17623]: Got next segment. Inline: true Aug 8 02:40:50.891449090 (17h0m50.480794077s) [upload=17623]: Waiting for error group managing segments... Aug 8 02:40:50.891479288 (17h0m50.480824275s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:40:50.891482724 (17h0m50.480827711s) [upload=17623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:40:50.891484928 (17h0m50.480829916s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:40:51.176437194 (17h0m50.765782181s) [upload=17623]: Done uploading segments... Aug 8 02:40:51.176454558 (17h0m50.765799545s) [upload=17623]: Upload finished. err: <nil> Aug 8 02:41:40.456141644 (17h1m40.045486631s) [upload=17634]: Starting upload Aug 8 02:41:40.456189395 (17h1m40.045534382s) [upload=17634]: Done starting upload Aug 8 02:41:40.456240302 (17h1m40.045585279s) [upload=17634]: Uploading segments... Aug 8 02:41:40.456275680 (17h1m40.045620667s) [upload=17634]: Got next segment. Inline: true Aug 8 02:41:40.456281992 (17h1m40.045626979s) [upload=17634]: Waiting for error group managing segments... Aug 8 02:41:40.456320576 (17h1m40.045665563s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:41:40.456325054 (17h1m40.045670041s) [upload=17634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:41:40.456327640 (17h1m40.045672627s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:41:40.725373772 (17h1m40.314718759s) [upload=17634]: Done uploading segments... Aug 8 02:41:40.725393891 (17h1m40.314738878s) [upload=17634]: Upload finished. err: <nil> Aug 8 02:42:18.916500038 (17h2m18.505845026s) [upload=17648]: Starting upload Aug 8 02:42:18.916547660 (17h2m18.505892647s) [upload=17648]: Done starting upload Aug 8 02:42:18.916596352 (17h2m18.505941339s) [upload=17648]: Uploading segments... Aug 8 02:42:18.916658392 (17h2m18.506003369s) [upload=17648]: Got next segment. Inline: true Aug 8 02:42:18.916661938 (17h2m18.506006925s) [upload=17648]: Waiting for error group managing segments... Aug 8 02:42:18.916695282 (17h2m18.506040269s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:18.916698909 (17h2m18.506043896s) [upload=17648]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:18.916701193 (17h2m18.50604618s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:19.193973927 (17h2m18.783318914s) [upload=17648]: Done uploading segments... Aug 8 02:42:19.193991100 (17h2m18.783336077s) [upload=17648]: Upload finished. err: <nil> Aug 8 02:42:58.890360693 (17h2m58.47970568s) [upload=17661]: Starting upload Aug 8 02:42:58.890404207 (17h2m58.479749184s) [upload=17661]: Done starting upload Aug 8 02:42:58.890474671 (17h2m58.479819648s) [upload=17661]: Uploading segments... Aug 8 02:42:58.890574633 (17h2m58.47991962s) [upload=17661]: Got next segment. Inline: true Aug 8 02:42:58.890582137 (17h2m58.479927124s) [upload=17661]: Waiting for error group managing segments... Aug 8 02:42:58.890627744 (17h2m58.479972731s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:58.890632343 (17h2m58.47997733s) [upload=17661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:58.890634747 (17h2m58.479979735s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:59.153940458 (17h2m58.743285445s) [upload=17661]: Done uploading segments... Aug 8 02:42:59.153957561 (17h2m58.743302548s) [upload=17661]: Upload finished. err: <nil> Aug 8 02:43:14.605916109 (17h3m14.195261097s) [upload=17664]: Starting upload Aug 8 02:43:14.605961686 (17h3m14.195306673s) [upload=17664]: Done starting upload Aug 8 02:43:14.606008837 (17h3m14.195353824s) [upload=17664]: Uploading segments... Aug 8 02:43:14.606036519 (17h3m14.195381507s) [upload=17664]: Got next segment. Inline: true Aug 8 02:43:14.606040727 (17h3m14.195385714s) [upload=17664]: Waiting for error group managing segments... Aug 8 02:43:14.606071226 (17h3m14.195416213s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:43:14.606074822 (17h3m14.195419809s) [upload=17664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:43:14.606077037 (17h3m14.195422014s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:43:15.086515746 (17h3m14.675860733s) [upload=17664]: Done uploading segments... Aug 8 02:43:15.086535755 (17h3m14.675880742s) [upload=17664]: Upload finished. err: <nil> Aug 8 02:44:21.512451853 (17h4m21.10179684s) [upload=17682]: Starting upload Aug 8 02:44:21.512548678 (17h4m21.101893715s) [upload=17682]: Done starting upload Aug 8 02:44:21.512650974 (17h4m21.101996021s) [upload=17682]: Uploading segments... Aug 8 02:44:21.512733792 (17h4m21.102078819s) [upload=17682]: Got next segment. Inline: true Aug 8 02:44:21.512742368 (17h4m21.102087415s) [upload=17682]: Waiting for error group managing segments... Aug 8 02:44:21.512810519 (17h4m21.102155546s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:44:21.512821259 (17h4m21.102166286s) [upload=17682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:44:21.512828252 (17h4m21.1021733s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:44:21.800057316 (17h4m21.389402293s) [upload=17682]: Done uploading segments... Aug 8 02:44:21.800074298 (17h4m21.389419275s) [upload=17682]: Upload finished. err: <nil> Aug 8 02:45:06.002102658 (17h5m5.591447656s) [upload=17693]: Starting upload Aug 8 02:45:06.002150069 (17h5m5.591495067s) [upload=17693]: Done starting upload Aug 8 02:45:06.002204814 (17h5m5.591549831s) [upload=17693]: Uploading segments... Aug 8 02:45:06.002252906 (17h5m5.591597903s) [upload=17693]: Got next segment. Inline: true Aug 8 02:45:06.002259659 (17h5m5.591604666s) [upload=17693]: Waiting for error group managing segments... Aug 8 02:45:06.002322419 (17h5m5.591667416s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:06.002328991 (17h5m5.591674008s) [upload=17693]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:06.002332989 (17h5m5.591677976s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:06.284691253 (17h5m5.87403624s) [upload=17693]: Done uploading segments... Aug 8 02:45:06.284708034 (17h5m5.874053021s) [upload=17693]: Upload finished. err: <nil> Aug 8 02:45:35.490537847 (17h5m35.079882834s) [upload=17702]: Starting upload Aug 8 02:45:35.490580207 (17h5m35.079925194s) [upload=17702]: Done starting upload Aug 8 02:45:35.490658277 (17h5m35.080003264s) [upload=17702]: Uploading segments... Aug 8 02:45:35.490698374 (17h5m35.080043351s) [upload=17702]: Got next segment. Inline: true Aug 8 02:45:35.490701831 (17h5m35.080046808s) [upload=17702]: Waiting for error group managing segments... Aug 8 02:45:35.490733862 (17h5m35.080078849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:35.490737629 (17h5m35.080082606s) [upload=17702]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:35.490739923 (17h5m35.0800849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:35.756406788 (17h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Duration: 1.88324118s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X........................X...........X....................] duration: 5.647534941s FAIL (2025-08-08 02:52:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.647561662s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X.X.............................................X......] duration: 1.924285972s FAIL (2025-08-08 02:51:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== em_ObjectCommit Aug 8 02:40:22.693731298 (17h0m22.283076285s) [upload=17615]: Done uploading segments... Aug 8 02:40:22.693748982 (17h0m22.283093969s) [upload=17615]: Upload finished. err: <nil> Aug 8 02:40:50.891334842 (17h0m50.480679829s) [upload=17623]: Starting upload Aug 8 02:40:50.891373465 (17h0m50.480718452s) [upload=17623]: Done starting upload Aug 8 02:40:50.891420756 (17h0m50.480765743s) [upload=17623]: Uploading segments... Aug 8 02:40:50.891445724 (17h0m50.480790711s) [upload=17623]: Got next segment. Inline: true Aug 8 02:40:50.891449090 (17h0m50.480794077s) [upload=17623]: Waiting for error group managing segments... Aug 8 02:40:50.891479288 (17h0m50.480824275s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:40:50.891482724 (17h0m50.480827711s) [upload=17623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:40:50.891484928 (17h0m50.480829916s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:40:51.176437194 (17h0m50.765782181s) [upload=17623]: Done uploading segments... Aug 8 02:40:51.176454558 (17h0m50.765799545s) [upload=17623]: Upload finished. err: <nil> Aug 8 02:41:40.456141644 (17h1m40.045486631s) [upload=17634]: Starting upload Aug 8 02:41:40.456189395 (17h1m40.045534382s) [upload=17634]: Done starting upload Aug 8 02:41:40.456240302 (17h1m40.045585279s) [upload=17634]: Uploading segments... Aug 8 02:41:40.456275680 (17h1m40.045620667s) [upload=17634]: Got next segment. Inline: true Aug 8 02:41:40.456281992 (17h1m40.045626979s) [upload=17634]: Waiting for error group managing segments... Aug 8 02:41:40.456320576 (17h1m40.045665563s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:41:40.456325054 (17h1m40.045670041s) [upload=17634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:41:40.456327640 (17h1m40.045672627s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:41:40.725373772 (17h1m40.314718759s) [upload=17634]: Done uploading segments... Aug 8 02:41:40.725393891 (17h1m40.314738878s) [upload=17634]: Upload finished. err: <nil> Aug 8 02:42:18.916500038 (17h2m18.505845026s) [upload=17648]: Starting upload Aug 8 02:42:18.916547660 (17h2m18.505892647s) [upload=17648]: Done starting upload Aug 8 02:42:18.916596352 (17h2m18.505941339s) [upload=17648]: Uploading segments... Aug 8 02:42:18.916658392 (17h2m18.506003369s) [upload=17648]: Got next segment. Inline: true Aug 8 02:42:18.916661938 (17h2m18.506006925s) [upload=17648]: Waiting for error group managing segments... Aug 8 02:42:18.916695282 (17h2m18.506040269s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:18.916698909 (17h2m18.506043896s) [upload=17648]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:18.916701193 (17h2m18.50604618s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:19.193973927 (17h2m18.783318914s) [upload=17648]: Done uploading segments... Aug 8 02:42:19.193991100 (17h2m18.783336077s) [upload=17648]: Upload finished. err: <nil> Aug 8 02:42:58.890360693 (17h2m58.47970568s) [upload=17661]: Starting upload Aug 8 02:42:58.890404207 (17h2m58.479749184s) [upload=17661]: Done starting upload Aug 8 02:42:58.890474671 (17h2m58.479819648s) [upload=17661]: Uploading segments... Aug 8 02:42:58.890574633 (17h2m58.47991962s) [upload=17661]: Got next segment. Inline: true Aug 8 02:42:58.890582137 (17h2m58.479927124s) [upload=17661]: Waiting for error group managing segments... Aug 8 02:42:58.890627744 (17h2m58.479972731s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:58.890632343 (17h2m58.47997733s) [upload=17661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:58.890634747 (17h2m58.479979735s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:59.153940458 (17h2m58.743285445s) [upload=17661]: Done uploading segments... Aug 8 02:42:59.153957561 (17h2m58.743302548s) [upload=17661]: Upload finished. err: <nil> Aug 8 02:43:14.605916109 (17h3m14.195261097s) [upload=17664]: Starting upload Aug 8 02:43:14.605961686 (17h3m14.195306673s) [upload=17664]: Done starting upload Aug 8 02:43:14.606008837 (17h3m14.195353824s) [upload=17664]: Uploading segments... Aug 8 02:43:14.606036519 (17h3m14.195381507s) [upload=17664]: Got next segment. Inline: true Aug 8 02:43:14.606040727 (17h3m14.195385714s) [upload=17664]: Waiting for error group managing segments... Aug 8 02:43:14.606071226 (17h3m14.195416213s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:43:14.606074822 (17h3m14.195419809s) [upload=17664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:43:14.606077037 (17h3m14.195422014s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:43:15.086515746 (17h3m14.675860733s) [upload=17664]: Done uploading segments... Aug 8 02:43:15.086535755 (17h3m14.675880742s) [upload=17664]: Upload finished. err: <nil> Aug 8 02:44:21.512451853 (17h4m21.10179684s) [upload=17682]: Starting upload Aug 8 02:44:21.512548678 (17h4m21.101893715s) [upload=17682]: Done starting upload Aug 8 02:44:21.512650974 (17h4m21.101996021s) [upload=17682]: Uploading segments... Aug 8 02:44:21.512733792 (17h4m21.102078819s) [upload=17682]: Got next segment. Inline: true Aug 8 02:44:21.512742368 (17h4m21.102087415s) [upload=17682]: Waiting for error group managing segments... Aug 8 02:44:21.512810519 (17h4m21.102155546s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:44:21.512821259 (17h4m21.102166286s) [upload=17682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:44:21.512828252 (17h4m21.1021733s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:44:21.800057316 (17h4m21.389402293s) [upload=17682]: Done uploading segments... Aug 8 02:44:21.800074298 (17h4m21.389419275s) [upload=17682]: Upload finished. err: <nil> Aug 8 02:45:06.002102658 (17h5m5.591447656s) [upload=17693]: Starting upload Aug 8 02:45:06.002150069 (17h5m5.591495067s) [upload=17693]: Done starting upload Aug 8 02:45:06.002204814 (17h5m5.591549831s) [upload=17693]: Uploading segments... Aug 8 02:45:06.002252906 (17h5m5.591597903s) [upload=17693]: Got next segment. Inline: true Aug 8 02:45:06.002259659 (17h5m5.591604666s) [upload=17693]: Waiting for error group managing segments... Aug 8 02:45:06.002322419 (17h5m5.591667416s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:06.002328991 (17h5m5.591674008s) [upload=17693]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:06.002332989 (17h5m5.591677976s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:06.284691253 (17h5m5.87403624s) [upload=17693]: Done uploading segments... Aug 8 02:45:06.284708034 (17h5m5.874053021s) [upload=17693]: Upload finished. err: <nil> Aug 8 02:45:35.490537847 (17h5m35.079882834s) [upload=17702]: Starting upload Aug 8 02:45:35.490580207 (17h5m35.079925194s) [upload=17702]: Done starting upload Aug 8 02:45:35.490658277 (17h5m35.080003264s) [upload=17702]: Uploading segments... Aug 8 02:45:35.490698374 (17h5m35.080043351s) [upload=17702]: Got next segment. Inline: true Aug 8 02:45:35.490701831 (17h5m35.080046808s) [upload=17702]: Waiting for error group managing segments... Aug 8 02:45:35.490733862 (17h5m35.080078849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:35.490737629 (17h5m35.080082606s) [upload=17702]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:35.490739923 (17h5m35.0800849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:35.756406788 (17h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Duration: 1.924313394s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X........................X...........X...................] duration: 5.801318582s FAIL (2025-08-08 02:51:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.801340864s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X........................X...........X..................] duration: 5.723578272s FAIL (2025-08-08 02:50:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.723602058s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X.X.............................................X.....] duration: 1.889383706s FAIL (2025-08-08 02:50:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== em_ObjectCommit Aug 8 02:40:22.693731298 (17h0m22.283076285s) [upload=17615]: Done uploading segments... Aug 8 02:40:22.693748982 (17h0m22.283093969s) [upload=17615]: Upload finished. err: <nil> Aug 8 02:40:50.891334842 (17h0m50.480679829s) [upload=17623]: Starting upload Aug 8 02:40:50.891373465 (17h0m50.480718452s) [upload=17623]: Done starting upload Aug 8 02:40:50.891420756 (17h0m50.480765743s) [upload=17623]: Uploading segments... Aug 8 02:40:50.891445724 (17h0m50.480790711s) [upload=17623]: Got next segment. Inline: true Aug 8 02:40:50.891449090 (17h0m50.480794077s) [upload=17623]: Waiting for error group managing segments... Aug 8 02:40:50.891479288 (17h0m50.480824275s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:40:50.891482724 (17h0m50.480827711s) [upload=17623]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:40:50.891484928 (17h0m50.480829916s) [upload=17623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:40:51.176437194 (17h0m50.765782181s) [upload=17623]: Done uploading segments... Aug 8 02:40:51.176454558 (17h0m50.765799545s) [upload=17623]: Upload finished. err: <nil> Aug 8 02:41:40.456141644 (17h1m40.045486631s) [upload=17634]: Starting upload Aug 8 02:41:40.456189395 (17h1m40.045534382s) [upload=17634]: Done starting upload Aug 8 02:41:40.456240302 (17h1m40.045585279s) [upload=17634]: Uploading segments... Aug 8 02:41:40.456275680 (17h1m40.045620667s) [upload=17634]: Got next segment. Inline: true Aug 8 02:41:40.456281992 (17h1m40.045626979s) [upload=17634]: Waiting for error group managing segments... Aug 8 02:41:40.456320576 (17h1m40.045665563s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:41:40.456325054 (17h1m40.045670041s) [upload=17634]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:41:40.456327640 (17h1m40.045672627s) [upload=17634]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:41:40.725373772 (17h1m40.314718759s) [upload=17634]: Done uploading segments... Aug 8 02:41:40.725393891 (17h1m40.314738878s) [upload=17634]: Upload finished. err: <nil> Aug 8 02:42:18.916500038 (17h2m18.505845026s) [upload=17648]: Starting upload Aug 8 02:42:18.916547660 (17h2m18.505892647s) [upload=17648]: Done starting upload Aug 8 02:42:18.916596352 (17h2m18.505941339s) [upload=17648]: Uploading segments... Aug 8 02:42:18.916658392 (17h2m18.506003369s) [upload=17648]: Got next segment. Inline: true Aug 8 02:42:18.916661938 (17h2m18.506006925s) [upload=17648]: Waiting for error group managing segments... Aug 8 02:42:18.916695282 (17h2m18.506040269s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:18.916698909 (17h2m18.506043896s) [upload=17648]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:18.916701193 (17h2m18.50604618s) [upload=17648]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:19.193973927 (17h2m18.783318914s) [upload=17648]: Done uploading segments... Aug 8 02:42:19.193991100 (17h2m18.783336077s) [upload=17648]: Upload finished. err: <nil> Aug 8 02:42:58.890360693 (17h2m58.47970568s) [upload=17661]: Starting upload Aug 8 02:42:58.890404207 (17h2m58.479749184s) [upload=17661]: Done starting upload Aug 8 02:42:58.890474671 (17h2m58.479819648s) [upload=17661]: Uploading segments... Aug 8 02:42:58.890574633 (17h2m58.47991962s) [upload=17661]: Got next segment. Inline: true Aug 8 02:42:58.890582137 (17h2m58.479927124s) [upload=17661]: Waiting for error group managing segments... Aug 8 02:42:58.890627744 (17h2m58.479972731s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:42:58.890632343 (17h2m58.47997733s) [upload=17661]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:42:58.890634747 (17h2m58.479979735s) [upload=17661]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:42:59.153940458 (17h2m58.743285445s) [upload=17661]: Done uploading segments... Aug 8 02:42:59.153957561 (17h2m58.743302548s) [upload=17661]: Upload finished. err: <nil> Aug 8 02:43:14.605916109 (17h3m14.195261097s) [upload=17664]: Starting upload Aug 8 02:43:14.605961686 (17h3m14.195306673s) [upload=17664]: Done starting upload Aug 8 02:43:14.606008837 (17h3m14.195353824s) [upload=17664]: Uploading segments... Aug 8 02:43:14.606036519 (17h3m14.195381507s) [upload=17664]: Got next segment. Inline: true Aug 8 02:43:14.606040727 (17h3m14.195385714s) [upload=17664]: Waiting for error group managing segments... Aug 8 02:43:14.606071226 (17h3m14.195416213s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:43:14.606074822 (17h3m14.195419809s) [upload=17664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:43:14.606077037 (17h3m14.195422014s) [upload=17664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:43:15.086515746 (17h3m14.675860733s) [upload=17664]: Done uploading segments... Aug 8 02:43:15.086535755 (17h3m14.675880742s) [upload=17664]: Upload finished. err: <nil> Aug 8 02:44:21.512451853 (17h4m21.10179684s) [upload=17682]: Starting upload Aug 8 02:44:21.512548678 (17h4m21.101893715s) [upload=17682]: Done starting upload Aug 8 02:44:21.512650974 (17h4m21.101996021s) [upload=17682]: Uploading segments... Aug 8 02:44:21.512733792 (17h4m21.102078819s) [upload=17682]: Got next segment. Inline: true Aug 8 02:44:21.512742368 (17h4m21.102087415s) [upload=17682]: Waiting for error group managing segments... Aug 8 02:44:21.512810519 (17h4m21.102155546s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:44:21.512821259 (17h4m21.102166286s) [upload=17682]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:44:21.512828252 (17h4m21.1021733s) [upload=17682]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:44:21.800057316 (17h4m21.389402293s) [upload=17682]: Done uploading segments... Aug 8 02:44:21.800074298 (17h4m21.389419275s) [upload=17682]: Upload finished. err: <nil> Aug 8 02:45:06.002102658 (17h5m5.591447656s) [upload=17693]: Starting upload Aug 8 02:45:06.002150069 (17h5m5.591495067s) [upload=17693]: Done starting upload Aug 8 02:45:06.002204814 (17h5m5.591549831s) [upload=17693]: Uploading segments... Aug 8 02:45:06.002252906 (17h5m5.591597903s) [upload=17693]: Got next segment. Inline: true Aug 8 02:45:06.002259659 (17h5m5.591604666s) [upload=17693]: Waiting for error group managing segments... Aug 8 02:45:06.002322419 (17h5m5.591667416s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:06.002328991 (17h5m5.591674008s) [upload=17693]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:06.002332989 (17h5m5.591677976s) [upload=17693]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:06.284691253 (17h5m5.87403624s) [upload=17693]: Done uploading segments... Aug 8 02:45:06.284708034 (17h5m5.874053021s) [upload=17693]: Upload finished. err: <nil> Aug 8 02:45:35.490537847 (17h5m35.079882834s) [upload=17702]: Starting upload Aug 8 02:45:35.490580207 (17h5m35.079925194s) [upload=17702]: Done starting upload Aug 8 02:45:35.490658277 (17h5m35.080003264s) [upload=17702]: Uploading segments... Aug 8 02:45:35.490698374 (17h5m35.080043351s) [upload=17702]: Got next segment. Inline: true Aug 8 02:45:35.490701831 (17h5m35.080046808s) [upload=17702]: Waiting for error group managing segments... Aug 8 02:45:35.490733862 (17h5m35.080078849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:45:35.490737629 (17h5m35.080082606s) [upload=17702]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:45:35.490739923 (17h5m35.0800849s) [upload=17702]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:45:35.756406788 (17h5m35.345751775s) [upload=17702]: Done uploading segments... Aug 8 02:45:35.756424571 (17h5m35.345769548s) [upload=17702]: Upload finished. err: <nil> Aug 8 02:46:33.552803684 (17h6m33.142148671s) [upload=17718]: Starting upload Aug 8 02:46:33.552851526 (17h6m33.142196513s) [upload=17718]: Done starting upload Aug 8 02:46:33.552926830 (17h6m33.142271817s) [upload=17718]: Uploading segments... Aug 8 02:46:33.553018405 (17h6m33.142363392s) [upload=17718]: Got next segment. Inline: true Aug 8 02:46:33.553023094 (17h6m33.142368081s) [upload=17718]: Waiting for error group managing segments... Aug 8 02:46:33.553079311 (17h6m33.142424288s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:46:33.553084532 (17h6m33.142429519s) [upload=17718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:46:33.553086756 (17h6m33.142431743s) [upload=17718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:46:33.825744517 (17h6m33.415089504s) [upload=17718]: Done uploading segments... Aug 8 02:46:33.825824691 (17h6m33.415169698s) [upload=17718]: Upload finished. err: <nil> Aug 8 02:47:20.344214264 (17h7m19.933559241s) [upload=17732]: Starting upload Aug 8 02:47:20.344259111 (17h7m19.933604098s) [upload=17732]: Done starting upload Aug 8 02:47:20.344345786 (17h7m19.933690773s) [upload=17732]: Uploading segments... Aug 8 02:47:20.344429647 (17h7m19.933774634s) [upload=17732]: Got next segment. Inline: true Aug 8 02:47:20.344434666 (17h7m19.933779643s) [upload=17732]: Waiting for error group managing segments... Aug 8 02:47:20.344488088 (17h7m19.933833075s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:47:20.344492588 (17h7m19.933837575s) [upload=17732]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 02:47:20.344495203 (17h7m19.93384019s) [upload=17732]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:47:20.559854955 (17h7m20.149199942s) [upload=17732]: Done uploading segments... Aug 8 02:47:20.559872309 (17h7m20.149217296s) [upload=17732]: Upload finished. err: metaclient: Too Many Requests Duration: 1.889412732s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X........................X...........X.................] duration: 5.791832213s FAIL (2025-08-08 02:49:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== d finished. err: <nil> Aug 8 02:36:32.418600277 (16h56m32.007945264s) [upload=17541]: Starting upload Aug 8 02:36:32.418646175 (16h56m32.007991152s) [upload=17541]: Done starting upload Aug 8 02:36:32.418711751 (16h56m32.008056739s) [upload=17541]: Uploading segments... Aug 8 02:36:32.418899640 (16h56m32.008244627s) [upload=17541]: Got next segment. Inline: false Aug 8 02:36:32.418931120 (16h56m32.008276107s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 02:36:32.418935279 (16h56m32.008280266s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 02:36:32.904015319 (16h56m32.493360356s) [seg_pos={0 0}, upload=17541]: Begin upload segment... Aug 8 02:36:32.904077438 (16h56m32.493422425s) [seg_pos={0 0}, upload=17541]: Done begin upload segment. Aug 8 02:36:32.904105982 (16h56m32.493450969s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904112384 (16h56m32.493457371s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904201025 (16h56m32.493546012s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904519243 (16h56m32.49386423s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904656305 (16h56m32.494001292s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.904950889 (16h56m32.494295866s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905275460 (16h56m32.494620447s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905525709 (16h56m32.494870696s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.905656049 (16h56m32.495001096s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906048880 (16h56m32.495393867s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906145725 (16h56m32.495490712s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906342501 (16h56m32.495687488s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906623329 (16h56m32.495968316s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.906879849 (16h56m32.496224827s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908702226 (16h56m32.498047213s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.908977222 (16h56m32.498322199s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.909407466 (16h56m32.498752453s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:32.919876206 (16h56m32.509221193s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Uploading piece... Aug 8 02:36:34.399057381 (16h56m33.988402368s) [upload=17541]: Next returned nil segment Aug 8 02:36:34.399075496 (16h56m33.988420483s) [upload=17541]: Waiting for error group managing segments... Aug 8 02:36:34.782405268 (16h56m34.371750255s) [noise=true , address=45.91.116.11:4135 , piece_id=MJ4G65XLICEGFTHAYYKG4EQNOMY2WOOTXM7EJ2NVG4P54RINJRTA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.816942738 (16h56m34.406287725s) [noise=true , address=104.36.82.56:4253 , piece_id=EGTW7FGCNBIJ5KK6OABEERQU7HS6OHZ5K5HTSUZHLKDGSFB2D7GQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.823597291 (16h56m34.412942298s) [noise=true , address=104.36.82.4:4833 , piece_id=JVD7WH2YELO4OWHYDUH5LBB6NA5BONDRDWXKXB44SDA5QAZKSKYA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.827149146 (16h56m34.416494133s) [noise=true , address=104.36.82.23:4459 , piece_id=N2M5OJQFAUZM2OV2ALK5PUM7VRWARLRNUI4XL576H7B52C7DJ5FA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.830102608 (16h56m34.419447595s) [noise=true , address=104.36.82.19:4429 , piece_id=ROTUJYK6HBJU6ZN5D2QS7SLZUT4PNCAMKMWK2YCHQP2JWT6YCMYQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.903207138 (16h56m34.492552125s) [noise=true , address=104.36.82.44:4893 , piece_id=PXD2NSTGLJYAPWIMM6PNKFDKNFYEPNSNFFVDKVXCUBYICTSWPBMA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.906276069 (16h56m34.495621056s) [noise=true , address=104.36.82.46:4505 , piece_id=A3EJTYNJCCPJVHAPTVWS7CCJMXELGTQKIFJ3L3BNL4MM2KV6INDQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.909067350 (16h56m34.498412337s) [noise=true , address=104.36.82.61:4378 , piece_id=VBOPK77OYQBTVQCI6W74LWRPWKG7AR24O2MNIMIHLCLQU6IBKNZA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.913778123 (16h56m34.50312311s) [noise=true , address=104.36.82.13:4206 , piece_id=D3L6MS2R5U77D45BG576D6GXPNFFTSI2BOXHRMT5RJB3WJ6XACSQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.918818386 (16h56m34.508163373s) [noise=true , address=104.36.82.60:4357 , piece_id=7BAHG2RHJPY5XVGSKS3M6L2EY4KB4XH5UV4QF4FGOTTKO24JYBZQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.920171254 (16h56m34.509516241s) [noise=true , address=104.36.82.43:4850 , piece_id=77YU5SDK7IR4WOV6EMK5NBJ2BZ4MCD3BNEJAHAPXJRS6TK6GYCTQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.922873124 (16h56m34.512218112s) [noise=true , address=104.36.82.37:4685 , piece_id=DDWONONL64FZGD3TMRBKHCBQMQHDIOHNYTZ35YOY5CPAKW3GPVHA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.950631444 (16h56m34.539976431s) [noise=true , address=104.36.82.11:4137 , piece_id=D73GKRR22EYOAHPUXVLJ3VSTFYHRHY3DJGAKX4TBUPFL3YWWFZ4A, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969566733 (16h56m34.55891171s) [noise=true , address=104.36.82.36:4645 , piece_id=VK5CXSWDW3BWB2TJCRG2EHBRCF4MQT3BYDTURLDY3HPT7CHQR3WQ, seg_pos={0 0}, upload=17541]: Done uploading piece. err: <nil> Aug 8 02:36:34.969592623 (16h56m34.55893761s) [seg_pos={0 0}, upload=17541]: Segment reached optimal threshold of 14 pieces. Aug 8 02:36:34.969694527 (16h56m34.559039514s) [noise=true , address=104.36.82.35:4604 , piece_id=OMUP3APCIV3AJMZ4YDVFFFLYV7VZY2IFPSIAK2NGMBLT6ETYUDCA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969749622 (16h56m34.559094609s) [noise=true , address=104.36.82.16:4322 , piece_id=DTLB6FEMDPHOVZ23SQ65LMJ4QIOF3CQJKM3RHODXN7MYA72W6DDA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WwYqhEYC9QPkGDiSt5bF7izvhpsawWx5dwTqP5zZcPyigs1n3): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969842581 (16h56m34.559187568s) [noise=true , address=104.36.82.59:4308 , piece_id=IYIGQ2VVYCYFS7K5BMGL2PT5PW2NCE4RMK3YJKBIGRB6LTDDUUQA, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969857288 (16h56m34.559202266s) [noise=true , address=104.36.82.62:4434 , piece_id=UR4K4P4ZHLGALOKNYCZI3MW7DHF7JC7QHWPIIAWQ5CG6BH4W4M5Q, seg_pos={0 0}, upload=17541]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kZH2amRgBmyujKY7Kk4yEQRY8CJMfaz2hw2XRJ8tzRiHExvtX): protocol: expected piece hash; context canceled; EOF Aug 8 02:36:34.969907795 (16h56m34.559252782s) [seg_pos={0 0}, upload=17541]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 02:36:34.969974874 (16h56m34.559319861s) [upload=17541]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 02:36:34.969979212 (16h56m34.559324189s) [upload=17541]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 02:36:35.314163317 (16h56m34.903508304s) [upload=17541]: Done uploading segments... Aug 8 02:36:35.314183806 (16h56m34.903528793s) [upload=17541]: Upload finished. err: <nil> Duration: 5.791859015s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)