Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...X.........X........................X........X.....X......] duration: 1.878050856s FAIL (2025-08-07 12:54:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== questItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Aug 7 12:43:59.139566359 (3h3m58.728911346s) [upload=3215]: Starting upload Aug 7 12:43:59.139626314 (3h3m58.728971301s) [upload=3215]: Done starting upload Aug 7 12:43:59.139692420 (3h3m58.729037407s) [upload=3215]: Uploading segments... Aug 7 12:43:59.139812500 (3h3m58.729157487s) [upload=3215]: Got next segment. Inline: true Aug 7 12:43:59.139817600 (3h3m58.729162587s) [upload=3215]: Waiting for error group managing segments... Aug 7 12:43:59.139857276 (3h3m58.729202253s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:59.139862095 (3h3m58.729207082s) [upload=3215]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:59.139864649 (3h3m58.729209637s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:59.420568172 (3h3m59.009913169s) [upload=3215]: Done uploading segments... Aug 7 12:43:59.420591957 (3h3m59.009936974s) [upload=3215]: Upload finished. err: <nil> Aug 7 12:44:51.641577950 (3h4m51.230922927s) [upload=3230]: Starting upload Aug 7 12:44:51.641637654 (3h4m51.230982641s) [upload=3230]: Done starting upload Aug 7 12:44:51.641703038 (3h4m51.231048015s) [upload=3230]: Uploading segments... Aug 7 12:44:51.641752433 (3h4m51.23109742s) [upload=3230]: Got next segment. Inline: true Aug 7 12:44:51.641756501 (3h4m51.231101488s) [upload=3230]: Waiting for error group managing segments... Aug 7 12:44:51.641834660 (3h4m51.231179647s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:44:51.641850782 (3h4m51.231195769s) [upload=3230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:44:51.641853176 (3h4m51.231198153s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:44:52.045684554 (3h4m51.635029541s) [upload=3230]: Done uploading segments... Aug 7 12:44:52.045704021 (3h4m51.635049009s) [upload=3230]: Upload finished. err: <nil> Aug 7 12:45:36.266044075 (3h5m35.855389062s) [upload=3244]: Starting upload Aug 7 12:45:36.266095454 (3h5m35.855440431s) [upload=3244]: Done starting upload Aug 7 12:45:36.266148726 (3h5m35.855493713s) [upload=3244]: Uploading segments... Aug 7 12:45:36.266178563 (3h5m35.85552355s) [upload=3244]: Got next segment. Inline: true Aug 7 12:45:36.266182109 (3h5m35.855527086s) [upload=3244]: Waiting for error group managing segments... Aug 7 12:45:36.266214812 (3h5m35.855559799s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:45:36.266218329 (3h5m35.855563316s) [upload=3244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:45:36.266223980 (3h5m35.855568957s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:45:36.538124018 (3h5m36.127469025s) [upload=3244]: Done uploading segments... Aug 7 12:45:36.538142734 (3h5m36.127487711s) [upload=3244]: Upload finished. err: <nil> Aug 7 12:46:48.472789014 (3h6m48.062133991s) [upload=3261]: Starting upload Aug 7 12:46:48.472826775 (3h6m48.062171762s) [upload=3261]: Done starting upload Aug 7 12:46:48.472885838 (3h6m48.062230825s) [upload=3261]: Uploading segments... Aug 7 12:46:48.472917008 (3h6m48.062261995s) [upload=3261]: Got next segment. Inline: true Aug 7 12:46:48.472920465 (3h6m48.062265442s) [upload=3261]: Waiting for error group managing segments... Aug 7 12:46:48.472952817 (3h6m48.062297804s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:46:48.472956283 (3h6m48.062301271s) [upload=3261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:46:48.472958588 (3h6m48.062303575s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:46:48.748191913 (3h6m48.3375369s) [upload=3261]: Done uploading segments... Aug 7 12:46:48.748210889 (3h6m48.337555877s) [upload=3261]: Upload finished. err: <nil> Aug 7 12:47:51.331214594 (3h7m50.920559581s) [upload=3277]: Starting upload Aug 7 12:47:51.331250061 (3h7m50.920595048s) [upload=3277]: Done starting upload Aug 7 12:47:51.331294016 (3h7m50.920639003s) [upload=3277]: Uploading segments... Aug 7 12:47:51.331323142 (3h7m50.920668129s) [upload=3277]: Got next segment. Inline: true Aug 7 12:47:51.331326829 (3h7m50.920671816s) [upload=3277]: Waiting for error group managing segments... Aug 7 12:47:51.331358759 (3h7m50.920703747s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:51.331362577 (3h7m50.920707564s) [upload=3277]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:51.331364802 (3h7m50.920709789s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:51.603866170 (3h7m51.193211197s) [upload=3277]: Done uploading segments... Aug 7 12:47:51.603887010 (3h7m51.193231997s) [upload=3277]: Upload finished. err: <nil> Aug 7 12:48:47.521256329 (3h8m47.110601316s) [upload=3294]: Starting upload Aug 7 12:48:47.521298289 (3h8m47.110643266s) [upload=3294]: Done starting upload Aug 7 12:48:47.521349948 (3h8m47.110694935s) [upload=3294]: Uploading segments... Aug 7 12:48:47.521376278 (3h8m47.110721265s) [upload=3294]: Got next segment. Inline: true Aug 7 12:48:47.521388491 (3h8m47.110733478s) [upload=3294]: Waiting for error group managing segments... Aug 7 12:48:47.521422207 (3h8m47.110767194s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:47.521425874 (3h8m47.110770851s) [upload=3294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:47.521428128 (3h8m47.110773115s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:47.818306275 (3h8m47.407651272s) [upload=3294]: Done uploading segments... Aug 7 12:48:47.818323799 (3h8m47.407668786s) [upload=3294]: Upload finished. err: <nil> Duration: 1.87807446s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X..X.........] duration: 5.859560696s FAIL (2025-08-07 12:54:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2aa44c9765be58010e96b6026bae29242674695433d542aef14e18cd2e33fdf5 != before b16832a62110b705f59475591803403afadf619b6e8c0ea43b792a83c97ba921 ======LOGS====== ommit Aug 7 12:46:21.996752862 (3h6m21.586097849s) [upload=3257]: Done uploading segments... Aug 7 12:46:21.996770766 (3h6m21.586115753s) [upload=3257]: Upload finished. err: <nil> Aug 7 12:47:31.254217874 (3h7m30.843562861s) [upload=3274]: Starting upload Aug 7 12:47:31.254262930 (3h7m30.843607917s) [upload=3274]: Done starting upload Aug 7 12:47:31.254368042 (3h7m30.843713029s) [upload=3274]: Uploading segments... Aug 7 12:47:31.254508570 (3h7m30.843853557s) [upload=3274]: Got next segment. Inline: false Aug 7 12:47:31.254536885 (3h7m30.843881872s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:31.254540962 (3h7m30.843885939s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:47:31.700161194 (3h7m31.289506181s) [seg_pos={0 0}, upload=3274]: Begin upload segment... Aug 7 12:47:31.700216349 (3h7m31.289561326s) [seg_pos={0 0}, upload=3274]: Done begin upload segment. Aug 7 12:47:31.700238542 (3h7m31.289583519s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700328965 (3h7m31.289673962s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700600114 (3h7m31.289945101s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700860020 (3h7m31.290205007s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701112513 (3h7m31.2904575s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701260938 (3h7m31.290605925s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701372471 (3h7m31.290717458s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701605567 (3h7m31.290950544s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701834484 (3h7m31.291179471s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701852670 (3h7m31.291197657s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701904178 (3h7m31.291249165s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702086177 (3h7m31.291431154s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702312359 (3h7m31.291657346s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702368517 (3h7m31.291713504s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.703374160 (3h7m31.292719147s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704353204 (3h7m31.293698191s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704892575 (3h7m31.294237562s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.705331565 (3h7m31.294676552s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:32.796060244 (3h7m32.385405231s) [upload=3274]: Next returned nil segment Aug 7 12:47:32.796077607 (3h7m32.385422584s) [upload=3274]: Waiting for error group managing segments... Aug 7 12:47:33.075187900 (3h7m32.664532887s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.075537569 (3h7m32.664882546s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.108593073 (3h7m32.69793806s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.618603580 (3h7m33.207948568s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.621934483 (3h7m33.21127947s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.645974970 (3h7m33.235319947s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.647290497 (3h7m33.236635474s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.652413307 (3h7m33.241758304s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.656977099 (3h7m33.246322086s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.701452252 (3h7m33.290797229s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.707682883 (3h7m33.29702786s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.719107932 (3h7m33.308452919s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.754880525 (3h7m33.344225512s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769832351 (3h7m33.359177339s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769857339 (3h7m33.359202326s) [seg_pos={0 0}, upload=3274]: Segment reached optimal threshold of 14 pieces. Aug 7 12:47:33.769969273 (3h7m33.359314261s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770037485 (3h7m33.359382472s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770098962 (3h7m33.359443949s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770110054 (3h7m33.359455041s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770137867 (3h7m33.359482854s) [seg_pos={0 0}, upload=3274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:47:33.770202731 (3h7m33.359547718s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:47:33.770208171 (3h7m33.359553158s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:34.068591549 (3h7m33.657936536s) [upload=3274]: Done uploading segments... Aug 7 12:47:34.068615775 (3h7m33.657960763s) [upload=3274]: Upload finished. err: <nil> Duration: 5.859587677s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X..X........] duration: 5.571747664s FAIL (2025-08-07 12:53:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2aa44c9765be58010e96b6026bae29242674695433d542aef14e18cd2e33fdf5 != before b16832a62110b705f59475591803403afadf619b6e8c0ea43b792a83c97ba921 ======LOGS====== ommit Aug 7 12:46:21.996752862 (3h6m21.586097849s) [upload=3257]: Done uploading segments... Aug 7 12:46:21.996770766 (3h6m21.586115753s) [upload=3257]: Upload finished. err: <nil> Aug 7 12:47:31.254217874 (3h7m30.843562861s) [upload=3274]: Starting upload Aug 7 12:47:31.254262930 (3h7m30.843607917s) [upload=3274]: Done starting upload Aug 7 12:47:31.254368042 (3h7m30.843713029s) [upload=3274]: Uploading segments... Aug 7 12:47:31.254508570 (3h7m30.843853557s) [upload=3274]: Got next segment. Inline: false Aug 7 12:47:31.254536885 (3h7m30.843881872s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:31.254540962 (3h7m30.843885939s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:47:31.700161194 (3h7m31.289506181s) [seg_pos={0 0}, upload=3274]: Begin upload segment... Aug 7 12:47:31.700216349 (3h7m31.289561326s) [seg_pos={0 0}, upload=3274]: Done begin upload segment. Aug 7 12:47:31.700238542 (3h7m31.289583519s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700328965 (3h7m31.289673962s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700600114 (3h7m31.289945101s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700860020 (3h7m31.290205007s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701112513 (3h7m31.2904575s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701260938 (3h7m31.290605925s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701372471 (3h7m31.290717458s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701605567 (3h7m31.290950544s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701834484 (3h7m31.291179471s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701852670 (3h7m31.291197657s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701904178 (3h7m31.291249165s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702086177 (3h7m31.291431154s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702312359 (3h7m31.291657346s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702368517 (3h7m31.291713504s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.703374160 (3h7m31.292719147s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704353204 (3h7m31.293698191s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704892575 (3h7m31.294237562s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.705331565 (3h7m31.294676552s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:32.796060244 (3h7m32.385405231s) [upload=3274]: Next returned nil segment Aug 7 12:47:32.796077607 (3h7m32.385422584s) [upload=3274]: Waiting for error group managing segments... Aug 7 12:47:33.075187900 (3h7m32.664532887s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.075537569 (3h7m32.664882546s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.108593073 (3h7m32.69793806s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.618603580 (3h7m33.207948568s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.621934483 (3h7m33.21127947s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.645974970 (3h7m33.235319947s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.647290497 (3h7m33.236635474s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.652413307 (3h7m33.241758304s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.656977099 (3h7m33.246322086s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.701452252 (3h7m33.290797229s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.707682883 (3h7m33.29702786s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.719107932 (3h7m33.308452919s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.754880525 (3h7m33.344225512s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769832351 (3h7m33.359177339s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769857339 (3h7m33.359202326s) [seg_pos={0 0}, upload=3274]: Segment reached optimal threshold of 14 pieces. Aug 7 12:47:33.769969273 (3h7m33.359314261s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770037485 (3h7m33.359382472s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770098962 (3h7m33.359443949s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770110054 (3h7m33.359455041s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770137867 (3h7m33.359482854s) [seg_pos={0 0}, upload=3274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:47:33.770202731 (3h7m33.359547718s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:47:33.770208171 (3h7m33.359553158s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:34.068591549 (3h7m33.657936536s) [upload=3274]: Done uploading segments... Aug 7 12:47:34.068615775 (3h7m33.657960763s) [upload=3274]: Upload finished. err: <nil> Duration: 5.571773064s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [....X.........X........................X........X.....X.....] duration: 2.036051914s FAIL (2025-08-07 12:53:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== questItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Aug 7 12:43:59.139566359 (3h3m58.728911346s) [upload=3215]: Starting upload Aug 7 12:43:59.139626314 (3h3m58.728971301s) [upload=3215]: Done starting upload Aug 7 12:43:59.139692420 (3h3m58.729037407s) [upload=3215]: Uploading segments... Aug 7 12:43:59.139812500 (3h3m58.729157487s) [upload=3215]: Got next segment. Inline: true Aug 7 12:43:59.139817600 (3h3m58.729162587s) [upload=3215]: Waiting for error group managing segments... Aug 7 12:43:59.139857276 (3h3m58.729202253s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:59.139862095 (3h3m58.729207082s) [upload=3215]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:59.139864649 (3h3m58.729209637s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:59.420568172 (3h3m59.009913169s) [upload=3215]: Done uploading segments... Aug 7 12:43:59.420591957 (3h3m59.009936974s) [upload=3215]: Upload finished. err: <nil> Aug 7 12:44:51.641577950 (3h4m51.230922927s) [upload=3230]: Starting upload Aug 7 12:44:51.641637654 (3h4m51.230982641s) [upload=3230]: Done starting upload Aug 7 12:44:51.641703038 (3h4m51.231048015s) [upload=3230]: Uploading segments... Aug 7 12:44:51.641752433 (3h4m51.23109742s) [upload=3230]: Got next segment. Inline: true Aug 7 12:44:51.641756501 (3h4m51.231101488s) [upload=3230]: Waiting for error group managing segments... Aug 7 12:44:51.641834660 (3h4m51.231179647s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:44:51.641850782 (3h4m51.231195769s) [upload=3230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:44:51.641853176 (3h4m51.231198153s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:44:52.045684554 (3h4m51.635029541s) [upload=3230]: Done uploading segments... Aug 7 12:44:52.045704021 (3h4m51.635049009s) [upload=3230]: Upload finished. err: <nil> Aug 7 12:45:36.266044075 (3h5m35.855389062s) [upload=3244]: Starting upload Aug 7 12:45:36.266095454 (3h5m35.855440431s) [upload=3244]: Done starting upload Aug 7 12:45:36.266148726 (3h5m35.855493713s) [upload=3244]: Uploading segments... Aug 7 12:45:36.266178563 (3h5m35.85552355s) [upload=3244]: Got next segment. Inline: true Aug 7 12:45:36.266182109 (3h5m35.855527086s) [upload=3244]: Waiting for error group managing segments... Aug 7 12:45:36.266214812 (3h5m35.855559799s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:45:36.266218329 (3h5m35.855563316s) [upload=3244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:45:36.266223980 (3h5m35.855568957s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:45:36.538124018 (3h5m36.127469025s) [upload=3244]: Done uploading segments... Aug 7 12:45:36.538142734 (3h5m36.127487711s) [upload=3244]: Upload finished. err: <nil> Aug 7 12:46:48.472789014 (3h6m48.062133991s) [upload=3261]: Starting upload Aug 7 12:46:48.472826775 (3h6m48.062171762s) [upload=3261]: Done starting upload Aug 7 12:46:48.472885838 (3h6m48.062230825s) [upload=3261]: Uploading segments... Aug 7 12:46:48.472917008 (3h6m48.062261995s) [upload=3261]: Got next segment. Inline: true Aug 7 12:46:48.472920465 (3h6m48.062265442s) [upload=3261]: Waiting for error group managing segments... Aug 7 12:46:48.472952817 (3h6m48.062297804s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:46:48.472956283 (3h6m48.062301271s) [upload=3261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:46:48.472958588 (3h6m48.062303575s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:46:48.748191913 (3h6m48.3375369s) [upload=3261]: Done uploading segments... Aug 7 12:46:48.748210889 (3h6m48.337555877s) [upload=3261]: Upload finished. err: <nil> Aug 7 12:47:51.331214594 (3h7m50.920559581s) [upload=3277]: Starting upload Aug 7 12:47:51.331250061 (3h7m50.920595048s) [upload=3277]: Done starting upload Aug 7 12:47:51.331294016 (3h7m50.920639003s) [upload=3277]: Uploading segments... Aug 7 12:47:51.331323142 (3h7m50.920668129s) [upload=3277]: Got next segment. Inline: true Aug 7 12:47:51.331326829 (3h7m50.920671816s) [upload=3277]: Waiting for error group managing segments... Aug 7 12:47:51.331358759 (3h7m50.920703747s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:51.331362577 (3h7m50.920707564s) [upload=3277]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:51.331364802 (3h7m50.920709789s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:51.603866170 (3h7m51.193211197s) [upload=3277]: Done uploading segments... Aug 7 12:47:51.603887010 (3h7m51.193231997s) [upload=3277]: Upload finished. err: <nil> Aug 7 12:48:47.521256329 (3h8m47.110601316s) [upload=3294]: Starting upload Aug 7 12:48:47.521298289 (3h8m47.110643266s) [upload=3294]: Done starting upload Aug 7 12:48:47.521349948 (3h8m47.110694935s) [upload=3294]: Uploading segments... Aug 7 12:48:47.521376278 (3h8m47.110721265s) [upload=3294]: Got next segment. Inline: true Aug 7 12:48:47.521388491 (3h8m47.110733478s) [upload=3294]: Waiting for error group managing segments... Aug 7 12:48:47.521422207 (3h8m47.110767194s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:47.521425874 (3h8m47.110770851s) [upload=3294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:47.521428128 (3h8m47.110773115s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:47.818306275 (3h8m47.407651272s) [upload=3294]: Done uploading segments... Aug 7 12:48:47.818323799 (3h8m47.407668786s) [upload=3294]: Upload finished. err: <nil> Duration: 2.036074578s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X..X.......] duration: 5.887451548s FAIL (2025-08-07 12:52:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2aa44c9765be58010e96b6026bae29242674695433d542aef14e18cd2e33fdf5 != before b16832a62110b705f59475591803403afadf619b6e8c0ea43b792a83c97ba921 ======LOGS====== ommit Aug 7 12:46:21.996752862 (3h6m21.586097849s) [upload=3257]: Done uploading segments... Aug 7 12:46:21.996770766 (3h6m21.586115753s) [upload=3257]: Upload finished. err: <nil> Aug 7 12:47:31.254217874 (3h7m30.843562861s) [upload=3274]: Starting upload Aug 7 12:47:31.254262930 (3h7m30.843607917s) [upload=3274]: Done starting upload Aug 7 12:47:31.254368042 (3h7m30.843713029s) [upload=3274]: Uploading segments... Aug 7 12:47:31.254508570 (3h7m30.843853557s) [upload=3274]: Got next segment. Inline: false Aug 7 12:47:31.254536885 (3h7m30.843881872s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:31.254540962 (3h7m30.843885939s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:47:31.700161194 (3h7m31.289506181s) [seg_pos={0 0}, upload=3274]: Begin upload segment... Aug 7 12:47:31.700216349 (3h7m31.289561326s) [seg_pos={0 0}, upload=3274]: Done begin upload segment. Aug 7 12:47:31.700238542 (3h7m31.289583519s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700328965 (3h7m31.289673962s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700600114 (3h7m31.289945101s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700860020 (3h7m31.290205007s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701112513 (3h7m31.2904575s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701260938 (3h7m31.290605925s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701372471 (3h7m31.290717458s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701605567 (3h7m31.290950544s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701834484 (3h7m31.291179471s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701852670 (3h7m31.291197657s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701904178 (3h7m31.291249165s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702086177 (3h7m31.291431154s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702312359 (3h7m31.291657346s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702368517 (3h7m31.291713504s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.703374160 (3h7m31.292719147s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704353204 (3h7m31.293698191s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704892575 (3h7m31.294237562s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.705331565 (3h7m31.294676552s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:32.796060244 (3h7m32.385405231s) [upload=3274]: Next returned nil segment Aug 7 12:47:32.796077607 (3h7m32.385422584s) [upload=3274]: Waiting for error group managing segments... Aug 7 12:47:33.075187900 (3h7m32.664532887s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.075537569 (3h7m32.664882546s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.108593073 (3h7m32.69793806s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.618603580 (3h7m33.207948568s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.621934483 (3h7m33.21127947s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.645974970 (3h7m33.235319947s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.647290497 (3h7m33.236635474s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.652413307 (3h7m33.241758304s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.656977099 (3h7m33.246322086s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.701452252 (3h7m33.290797229s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.707682883 (3h7m33.29702786s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.719107932 (3h7m33.308452919s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.754880525 (3h7m33.344225512s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769832351 (3h7m33.359177339s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769857339 (3h7m33.359202326s) [seg_pos={0 0}, upload=3274]: Segment reached optimal threshold of 14 pieces. Aug 7 12:47:33.769969273 (3h7m33.359314261s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770037485 (3h7m33.359382472s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770098962 (3h7m33.359443949s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770110054 (3h7m33.359455041s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770137867 (3h7m33.359482854s) [seg_pos={0 0}, upload=3274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:47:33.770202731 (3h7m33.359547718s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:47:33.770208171 (3h7m33.359553158s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:34.068591549 (3h7m33.657936536s) [upload=3274]: Done uploading segments... Aug 7 12:47:34.068615775 (3h7m33.657960763s) [upload=3274]: Upload finished. err: <nil> Duration: 5.887477347s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....X.........X........................X........X.....X....] duration: 1.933316165s FAIL (2025-08-07 12:52:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== questItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Aug 7 12:43:59.139566359 (3h3m58.728911346s) [upload=3215]: Starting upload Aug 7 12:43:59.139626314 (3h3m58.728971301s) [upload=3215]: Done starting upload Aug 7 12:43:59.139692420 (3h3m58.729037407s) [upload=3215]: Uploading segments... Aug 7 12:43:59.139812500 (3h3m58.729157487s) [upload=3215]: Got next segment. Inline: true Aug 7 12:43:59.139817600 (3h3m58.729162587s) [upload=3215]: Waiting for error group managing segments... Aug 7 12:43:59.139857276 (3h3m58.729202253s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:59.139862095 (3h3m58.729207082s) [upload=3215]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:59.139864649 (3h3m58.729209637s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:59.420568172 (3h3m59.009913169s) [upload=3215]: Done uploading segments... Aug 7 12:43:59.420591957 (3h3m59.009936974s) [upload=3215]: Upload finished. err: <nil> Aug 7 12:44:51.641577950 (3h4m51.230922927s) [upload=3230]: Starting upload Aug 7 12:44:51.641637654 (3h4m51.230982641s) [upload=3230]: Done starting upload Aug 7 12:44:51.641703038 (3h4m51.231048015s) [upload=3230]: Uploading segments... Aug 7 12:44:51.641752433 (3h4m51.23109742s) [upload=3230]: Got next segment. Inline: true Aug 7 12:44:51.641756501 (3h4m51.231101488s) [upload=3230]: Waiting for error group managing segments... Aug 7 12:44:51.641834660 (3h4m51.231179647s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:44:51.641850782 (3h4m51.231195769s) [upload=3230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:44:51.641853176 (3h4m51.231198153s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:44:52.045684554 (3h4m51.635029541s) [upload=3230]: Done uploading segments... Aug 7 12:44:52.045704021 (3h4m51.635049009s) [upload=3230]: Upload finished. err: <nil> Aug 7 12:45:36.266044075 (3h5m35.855389062s) [upload=3244]: Starting upload Aug 7 12:45:36.266095454 (3h5m35.855440431s) [upload=3244]: Done starting upload Aug 7 12:45:36.266148726 (3h5m35.855493713s) [upload=3244]: Uploading segments... Aug 7 12:45:36.266178563 (3h5m35.85552355s) [upload=3244]: Got next segment. Inline: true Aug 7 12:45:36.266182109 (3h5m35.855527086s) [upload=3244]: Waiting for error group managing segments... Aug 7 12:45:36.266214812 (3h5m35.855559799s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:45:36.266218329 (3h5m35.855563316s) [upload=3244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:45:36.266223980 (3h5m35.855568957s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:45:36.538124018 (3h5m36.127469025s) [upload=3244]: Done uploading segments... Aug 7 12:45:36.538142734 (3h5m36.127487711s) [upload=3244]: Upload finished. err: <nil> Aug 7 12:46:48.472789014 (3h6m48.062133991s) [upload=3261]: Starting upload Aug 7 12:46:48.472826775 (3h6m48.062171762s) [upload=3261]: Done starting upload Aug 7 12:46:48.472885838 (3h6m48.062230825s) [upload=3261]: Uploading segments... Aug 7 12:46:48.472917008 (3h6m48.062261995s) [upload=3261]: Got next segment. Inline: true Aug 7 12:46:48.472920465 (3h6m48.062265442s) [upload=3261]: Waiting for error group managing segments... Aug 7 12:46:48.472952817 (3h6m48.062297804s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:46:48.472956283 (3h6m48.062301271s) [upload=3261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:46:48.472958588 (3h6m48.062303575s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:46:48.748191913 (3h6m48.3375369s) [upload=3261]: Done uploading segments... Aug 7 12:46:48.748210889 (3h6m48.337555877s) [upload=3261]: Upload finished. err: <nil> Aug 7 12:47:51.331214594 (3h7m50.920559581s) [upload=3277]: Starting upload Aug 7 12:47:51.331250061 (3h7m50.920595048s) [upload=3277]: Done starting upload Aug 7 12:47:51.331294016 (3h7m50.920639003s) [upload=3277]: Uploading segments... Aug 7 12:47:51.331323142 (3h7m50.920668129s) [upload=3277]: Got next segment. Inline: true Aug 7 12:47:51.331326829 (3h7m50.920671816s) [upload=3277]: Waiting for error group managing segments... Aug 7 12:47:51.331358759 (3h7m50.920703747s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:51.331362577 (3h7m50.920707564s) [upload=3277]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:51.331364802 (3h7m50.920709789s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:51.603866170 (3h7m51.193211197s) [upload=3277]: Done uploading segments... Aug 7 12:47:51.603887010 (3h7m51.193231997s) [upload=3277]: Upload finished. err: <nil> Aug 7 12:48:47.521256329 (3h8m47.110601316s) [upload=3294]: Starting upload Aug 7 12:48:47.521298289 (3h8m47.110643266s) [upload=3294]: Done starting upload Aug 7 12:48:47.521349948 (3h8m47.110694935s) [upload=3294]: Uploading segments... Aug 7 12:48:47.521376278 (3h8m47.110721265s) [upload=3294]: Got next segment. Inline: true Aug 7 12:48:47.521388491 (3h8m47.110733478s) [upload=3294]: Waiting for error group managing segments... Aug 7 12:48:47.521422207 (3h8m47.110767194s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:47.521425874 (3h8m47.110770851s) [upload=3294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:47.521428128 (3h8m47.110773115s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:47.818306275 (3h8m47.407651272s) [upload=3294]: Done uploading segments... Aug 7 12:48:47.818323799 (3h8m47.407668786s) [upload=3294]: Upload finished. err: <nil> Duration: 1.933349199s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X..X......] duration: 5.907609658s FAIL (2025-08-07 12:52:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2aa44c9765be58010e96b6026bae29242674695433d542aef14e18cd2e33fdf5 != before b16832a62110b705f59475591803403afadf619b6e8c0ea43b792a83c97ba921 ======LOGS====== ommit Aug 7 12:46:21.996752862 (3h6m21.586097849s) [upload=3257]: Done uploading segments... Aug 7 12:46:21.996770766 (3h6m21.586115753s) [upload=3257]: Upload finished. err: <nil> Aug 7 12:47:31.254217874 (3h7m30.843562861s) [upload=3274]: Starting upload Aug 7 12:47:31.254262930 (3h7m30.843607917s) [upload=3274]: Done starting upload Aug 7 12:47:31.254368042 (3h7m30.843713029s) [upload=3274]: Uploading segments... Aug 7 12:47:31.254508570 (3h7m30.843853557s) [upload=3274]: Got next segment. Inline: false Aug 7 12:47:31.254536885 (3h7m30.843881872s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:31.254540962 (3h7m30.843885939s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:47:31.700161194 (3h7m31.289506181s) [seg_pos={0 0}, upload=3274]: Begin upload segment... Aug 7 12:47:31.700216349 (3h7m31.289561326s) [seg_pos={0 0}, upload=3274]: Done begin upload segment. Aug 7 12:47:31.700238542 (3h7m31.289583519s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700328965 (3h7m31.289673962s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700600114 (3h7m31.289945101s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700860020 (3h7m31.290205007s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701112513 (3h7m31.2904575s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701260938 (3h7m31.290605925s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701372471 (3h7m31.290717458s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701605567 (3h7m31.290950544s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701834484 (3h7m31.291179471s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701852670 (3h7m31.291197657s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701904178 (3h7m31.291249165s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702086177 (3h7m31.291431154s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702312359 (3h7m31.291657346s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702368517 (3h7m31.291713504s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.703374160 (3h7m31.292719147s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704353204 (3h7m31.293698191s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704892575 (3h7m31.294237562s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.705331565 (3h7m31.294676552s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:32.796060244 (3h7m32.385405231s) [upload=3274]: Next returned nil segment Aug 7 12:47:32.796077607 (3h7m32.385422584s) [upload=3274]: Waiting for error group managing segments... Aug 7 12:47:33.075187900 (3h7m32.664532887s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.075537569 (3h7m32.664882546s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.108593073 (3h7m32.69793806s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.618603580 (3h7m33.207948568s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.621934483 (3h7m33.21127947s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.645974970 (3h7m33.235319947s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.647290497 (3h7m33.236635474s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.652413307 (3h7m33.241758304s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.656977099 (3h7m33.246322086s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.701452252 (3h7m33.290797229s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.707682883 (3h7m33.29702786s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.719107932 (3h7m33.308452919s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.754880525 (3h7m33.344225512s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769832351 (3h7m33.359177339s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769857339 (3h7m33.359202326s) [seg_pos={0 0}, upload=3274]: Segment reached optimal threshold of 14 pieces. Aug 7 12:47:33.769969273 (3h7m33.359314261s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770037485 (3h7m33.359382472s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770098962 (3h7m33.359443949s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770110054 (3h7m33.359455041s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770137867 (3h7m33.359482854s) [seg_pos={0 0}, upload=3274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:47:33.770202731 (3h7m33.359547718s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:47:33.770208171 (3h7m33.359553158s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:34.068591549 (3h7m33.657936536s) [upload=3274]: Done uploading segments... Aug 7 12:47:34.068615775 (3h7m33.657960763s) [upload=3274]: Upload finished. err: <nil> Duration: 5.907634315s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X..X.....] duration: 5.80658273s FAIL (2025-08-07 12:51:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2aa44c9765be58010e96b6026bae29242674695433d542aef14e18cd2e33fdf5 != before b16832a62110b705f59475591803403afadf619b6e8c0ea43b792a83c97ba921 ======LOGS====== ommit Aug 7 12:46:21.996752862 (3h6m21.586097849s) [upload=3257]: Done uploading segments... Aug 7 12:46:21.996770766 (3h6m21.586115753s) [upload=3257]: Upload finished. err: <nil> Aug 7 12:47:31.254217874 (3h7m30.843562861s) [upload=3274]: Starting upload Aug 7 12:47:31.254262930 (3h7m30.843607917s) [upload=3274]: Done starting upload Aug 7 12:47:31.254368042 (3h7m30.843713029s) [upload=3274]: Uploading segments... Aug 7 12:47:31.254508570 (3h7m30.843853557s) [upload=3274]: Got next segment. Inline: false Aug 7 12:47:31.254536885 (3h7m30.843881872s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:31.254540962 (3h7m30.843885939s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:47:31.700161194 (3h7m31.289506181s) [seg_pos={0 0}, upload=3274]: Begin upload segment... Aug 7 12:47:31.700216349 (3h7m31.289561326s) [seg_pos={0 0}, upload=3274]: Done begin upload segment. Aug 7 12:47:31.700238542 (3h7m31.289583519s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700328965 (3h7m31.289673962s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700600114 (3h7m31.289945101s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700860020 (3h7m31.290205007s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701112513 (3h7m31.2904575s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701260938 (3h7m31.290605925s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701372471 (3h7m31.290717458s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701605567 (3h7m31.290950544s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701834484 (3h7m31.291179471s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701852670 (3h7m31.291197657s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701904178 (3h7m31.291249165s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702086177 (3h7m31.291431154s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702312359 (3h7m31.291657346s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702368517 (3h7m31.291713504s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.703374160 (3h7m31.292719147s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704353204 (3h7m31.293698191s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704892575 (3h7m31.294237562s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.705331565 (3h7m31.294676552s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:32.796060244 (3h7m32.385405231s) [upload=3274]: Next returned nil segment Aug 7 12:47:32.796077607 (3h7m32.385422584s) [upload=3274]: Waiting for error group managing segments... Aug 7 12:47:33.075187900 (3h7m32.664532887s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.075537569 (3h7m32.664882546s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.108593073 (3h7m32.69793806s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.618603580 (3h7m33.207948568s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.621934483 (3h7m33.21127947s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.645974970 (3h7m33.235319947s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.647290497 (3h7m33.236635474s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.652413307 (3h7m33.241758304s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.656977099 (3h7m33.246322086s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.701452252 (3h7m33.290797229s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.707682883 (3h7m33.29702786s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.719107932 (3h7m33.308452919s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.754880525 (3h7m33.344225512s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769832351 (3h7m33.359177339s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769857339 (3h7m33.359202326s) [seg_pos={0 0}, upload=3274]: Segment reached optimal threshold of 14 pieces. Aug 7 12:47:33.769969273 (3h7m33.359314261s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770037485 (3h7m33.359382472s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770098962 (3h7m33.359443949s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770110054 (3h7m33.359455041s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770137867 (3h7m33.359482854s) [seg_pos={0 0}, upload=3274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:47:33.770202731 (3h7m33.359547718s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:47:33.770208171 (3h7m33.359553158s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:34.068591549 (3h7m33.657936536s) [upload=3274]: Done uploading segments... Aug 7 12:47:34.068615775 (3h7m33.657960763s) [upload=3274]: Upload finished. err: <nil> Duration: 5.806608237s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [......X.........X........................X........X.....X...] duration: 1.840391513s FAIL (2025-08-07 12:51:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== questItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Aug 7 12:43:59.139566359 (3h3m58.728911346s) [upload=3215]: Starting upload Aug 7 12:43:59.139626314 (3h3m58.728971301s) [upload=3215]: Done starting upload Aug 7 12:43:59.139692420 (3h3m58.729037407s) [upload=3215]: Uploading segments... Aug 7 12:43:59.139812500 (3h3m58.729157487s) [upload=3215]: Got next segment. Inline: true Aug 7 12:43:59.139817600 (3h3m58.729162587s) [upload=3215]: Waiting for error group managing segments... Aug 7 12:43:59.139857276 (3h3m58.729202253s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:59.139862095 (3h3m58.729207082s) [upload=3215]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:59.139864649 (3h3m58.729209637s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:59.420568172 (3h3m59.009913169s) [upload=3215]: Done uploading segments... Aug 7 12:43:59.420591957 (3h3m59.009936974s) [upload=3215]: Upload finished. err: <nil> Aug 7 12:44:51.641577950 (3h4m51.230922927s) [upload=3230]: Starting upload Aug 7 12:44:51.641637654 (3h4m51.230982641s) [upload=3230]: Done starting upload Aug 7 12:44:51.641703038 (3h4m51.231048015s) [upload=3230]: Uploading segments... Aug 7 12:44:51.641752433 (3h4m51.23109742s) [upload=3230]: Got next segment. Inline: true Aug 7 12:44:51.641756501 (3h4m51.231101488s) [upload=3230]: Waiting for error group managing segments... Aug 7 12:44:51.641834660 (3h4m51.231179647s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:44:51.641850782 (3h4m51.231195769s) [upload=3230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:44:51.641853176 (3h4m51.231198153s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:44:52.045684554 (3h4m51.635029541s) [upload=3230]: Done uploading segments... Aug 7 12:44:52.045704021 (3h4m51.635049009s) [upload=3230]: Upload finished. err: <nil> Aug 7 12:45:36.266044075 (3h5m35.855389062s) [upload=3244]: Starting upload Aug 7 12:45:36.266095454 (3h5m35.855440431s) [upload=3244]: Done starting upload Aug 7 12:45:36.266148726 (3h5m35.855493713s) [upload=3244]: Uploading segments... Aug 7 12:45:36.266178563 (3h5m35.85552355s) [upload=3244]: Got next segment. Inline: true Aug 7 12:45:36.266182109 (3h5m35.855527086s) [upload=3244]: Waiting for error group managing segments... Aug 7 12:45:36.266214812 (3h5m35.855559799s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:45:36.266218329 (3h5m35.855563316s) [upload=3244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:45:36.266223980 (3h5m35.855568957s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:45:36.538124018 (3h5m36.127469025s) [upload=3244]: Done uploading segments... Aug 7 12:45:36.538142734 (3h5m36.127487711s) [upload=3244]: Upload finished. err: <nil> Aug 7 12:46:48.472789014 (3h6m48.062133991s) [upload=3261]: Starting upload Aug 7 12:46:48.472826775 (3h6m48.062171762s) [upload=3261]: Done starting upload Aug 7 12:46:48.472885838 (3h6m48.062230825s) [upload=3261]: Uploading segments... Aug 7 12:46:48.472917008 (3h6m48.062261995s) [upload=3261]: Got next segment. Inline: true Aug 7 12:46:48.472920465 (3h6m48.062265442s) [upload=3261]: Waiting for error group managing segments... Aug 7 12:46:48.472952817 (3h6m48.062297804s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:46:48.472956283 (3h6m48.062301271s) [upload=3261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:46:48.472958588 (3h6m48.062303575s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:46:48.748191913 (3h6m48.3375369s) [upload=3261]: Done uploading segments... Aug 7 12:46:48.748210889 (3h6m48.337555877s) [upload=3261]: Upload finished. err: <nil> Aug 7 12:47:51.331214594 (3h7m50.920559581s) [upload=3277]: Starting upload Aug 7 12:47:51.331250061 (3h7m50.920595048s) [upload=3277]: Done starting upload Aug 7 12:47:51.331294016 (3h7m50.920639003s) [upload=3277]: Uploading segments... Aug 7 12:47:51.331323142 (3h7m50.920668129s) [upload=3277]: Got next segment. Inline: true Aug 7 12:47:51.331326829 (3h7m50.920671816s) [upload=3277]: Waiting for error group managing segments... Aug 7 12:47:51.331358759 (3h7m50.920703747s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:51.331362577 (3h7m50.920707564s) [upload=3277]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:51.331364802 (3h7m50.920709789s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:51.603866170 (3h7m51.193211197s) [upload=3277]: Done uploading segments... Aug 7 12:47:51.603887010 (3h7m51.193231997s) [upload=3277]: Upload finished. err: <nil> Aug 7 12:48:47.521256329 (3h8m47.110601316s) [upload=3294]: Starting upload Aug 7 12:48:47.521298289 (3h8m47.110643266s) [upload=3294]: Done starting upload Aug 7 12:48:47.521349948 (3h8m47.110694935s) [upload=3294]: Uploading segments... Aug 7 12:48:47.521376278 (3h8m47.110721265s) [upload=3294]: Got next segment. Inline: true Aug 7 12:48:47.521388491 (3h8m47.110733478s) [upload=3294]: Waiting for error group managing segments... Aug 7 12:48:47.521422207 (3h8m47.110767194s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:47.521425874 (3h8m47.110770851s) [upload=3294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:47.521428128 (3h8m47.110773115s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:47.818306275 (3h8m47.407651272s) [upload=3294]: Done uploading segments... Aug 7 12:48:47.818323799 (3h8m47.407668786s) [upload=3294]: Upload finished. err: <nil> Duration: 1.840416493s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X..X....] duration: 5.886772617s FAIL (2025-08-07 12:50:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2aa44c9765be58010e96b6026bae29242674695433d542aef14e18cd2e33fdf5 != before b16832a62110b705f59475591803403afadf619b6e8c0ea43b792a83c97ba921 ======LOGS====== ommit Aug 7 12:46:21.996752862 (3h6m21.586097849s) [upload=3257]: Done uploading segments... Aug 7 12:46:21.996770766 (3h6m21.586115753s) [upload=3257]: Upload finished. err: <nil> Aug 7 12:47:31.254217874 (3h7m30.843562861s) [upload=3274]: Starting upload Aug 7 12:47:31.254262930 (3h7m30.843607917s) [upload=3274]: Done starting upload Aug 7 12:47:31.254368042 (3h7m30.843713029s) [upload=3274]: Uploading segments... Aug 7 12:47:31.254508570 (3h7m30.843853557s) [upload=3274]: Got next segment. Inline: false Aug 7 12:47:31.254536885 (3h7m30.843881872s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:31.254540962 (3h7m30.843885939s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:47:31.700161194 (3h7m31.289506181s) [seg_pos={0 0}, upload=3274]: Begin upload segment... Aug 7 12:47:31.700216349 (3h7m31.289561326s) [seg_pos={0 0}, upload=3274]: Done begin upload segment. Aug 7 12:47:31.700238542 (3h7m31.289583519s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700328965 (3h7m31.289673962s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700600114 (3h7m31.289945101s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700860020 (3h7m31.290205007s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701112513 (3h7m31.2904575s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701260938 (3h7m31.290605925s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701372471 (3h7m31.290717458s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701605567 (3h7m31.290950544s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701834484 (3h7m31.291179471s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701852670 (3h7m31.291197657s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701904178 (3h7m31.291249165s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702086177 (3h7m31.291431154s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702312359 (3h7m31.291657346s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702368517 (3h7m31.291713504s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.703374160 (3h7m31.292719147s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704353204 (3h7m31.293698191s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704892575 (3h7m31.294237562s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.705331565 (3h7m31.294676552s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:32.796060244 (3h7m32.385405231s) [upload=3274]: Next returned nil segment Aug 7 12:47:32.796077607 (3h7m32.385422584s) [upload=3274]: Waiting for error group managing segments... Aug 7 12:47:33.075187900 (3h7m32.664532887s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.075537569 (3h7m32.664882546s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.108593073 (3h7m32.69793806s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.618603580 (3h7m33.207948568s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.621934483 (3h7m33.21127947s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.645974970 (3h7m33.235319947s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.647290497 (3h7m33.236635474s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.652413307 (3h7m33.241758304s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.656977099 (3h7m33.246322086s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.701452252 (3h7m33.290797229s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.707682883 (3h7m33.29702786s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.719107932 (3h7m33.308452919s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.754880525 (3h7m33.344225512s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769832351 (3h7m33.359177339s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769857339 (3h7m33.359202326s) [seg_pos={0 0}, upload=3274]: Segment reached optimal threshold of 14 pieces. Aug 7 12:47:33.769969273 (3h7m33.359314261s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770037485 (3h7m33.359382472s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770098962 (3h7m33.359443949s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770110054 (3h7m33.359455041s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770137867 (3h7m33.359482854s) [seg_pos={0 0}, upload=3274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:47:33.770202731 (3h7m33.359547718s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:47:33.770208171 (3h7m33.359553158s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:34.068591549 (3h7m33.657936536s) [upload=3274]: Done uploading segments... Aug 7 12:47:34.068615775 (3h7m33.657960763s) [upload=3274]: Upload finished. err: <nil> Duration: 5.886792946s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......X.........X........................X........X.....X..] duration: 1.813051859s FAIL (2025-08-07 12:50:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== questItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Aug 7 12:43:59.139566359 (3h3m58.728911346s) [upload=3215]: Starting upload Aug 7 12:43:59.139626314 (3h3m58.728971301s) [upload=3215]: Done starting upload Aug 7 12:43:59.139692420 (3h3m58.729037407s) [upload=3215]: Uploading segments... Aug 7 12:43:59.139812500 (3h3m58.729157487s) [upload=3215]: Got next segment. Inline: true Aug 7 12:43:59.139817600 (3h3m58.729162587s) [upload=3215]: Waiting for error group managing segments... Aug 7 12:43:59.139857276 (3h3m58.729202253s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:59.139862095 (3h3m58.729207082s) [upload=3215]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:59.139864649 (3h3m58.729209637s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:59.420568172 (3h3m59.009913169s) [upload=3215]: Done uploading segments... Aug 7 12:43:59.420591957 (3h3m59.009936974s) [upload=3215]: Upload finished. err: <nil> Aug 7 12:44:51.641577950 (3h4m51.230922927s) [upload=3230]: Starting upload Aug 7 12:44:51.641637654 (3h4m51.230982641s) [upload=3230]: Done starting upload Aug 7 12:44:51.641703038 (3h4m51.231048015s) [upload=3230]: Uploading segments... Aug 7 12:44:51.641752433 (3h4m51.23109742s) [upload=3230]: Got next segment. Inline: true Aug 7 12:44:51.641756501 (3h4m51.231101488s) [upload=3230]: Waiting for error group managing segments... Aug 7 12:44:51.641834660 (3h4m51.231179647s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:44:51.641850782 (3h4m51.231195769s) [upload=3230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:44:51.641853176 (3h4m51.231198153s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:44:52.045684554 (3h4m51.635029541s) [upload=3230]: Done uploading segments... Aug 7 12:44:52.045704021 (3h4m51.635049009s) [upload=3230]: Upload finished. err: <nil> Aug 7 12:45:36.266044075 (3h5m35.855389062s) [upload=3244]: Starting upload Aug 7 12:45:36.266095454 (3h5m35.855440431s) [upload=3244]: Done starting upload Aug 7 12:45:36.266148726 (3h5m35.855493713s) [upload=3244]: Uploading segments... Aug 7 12:45:36.266178563 (3h5m35.85552355s) [upload=3244]: Got next segment. Inline: true Aug 7 12:45:36.266182109 (3h5m35.855527086s) [upload=3244]: Waiting for error group managing segments... Aug 7 12:45:36.266214812 (3h5m35.855559799s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:45:36.266218329 (3h5m35.855563316s) [upload=3244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:45:36.266223980 (3h5m35.855568957s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:45:36.538124018 (3h5m36.127469025s) [upload=3244]: Done uploading segments... Aug 7 12:45:36.538142734 (3h5m36.127487711s) [upload=3244]: Upload finished. err: <nil> Aug 7 12:46:48.472789014 (3h6m48.062133991s) [upload=3261]: Starting upload Aug 7 12:46:48.472826775 (3h6m48.062171762s) [upload=3261]: Done starting upload Aug 7 12:46:48.472885838 (3h6m48.062230825s) [upload=3261]: Uploading segments... Aug 7 12:46:48.472917008 (3h6m48.062261995s) [upload=3261]: Got next segment. Inline: true Aug 7 12:46:48.472920465 (3h6m48.062265442s) [upload=3261]: Waiting for error group managing segments... Aug 7 12:46:48.472952817 (3h6m48.062297804s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:46:48.472956283 (3h6m48.062301271s) [upload=3261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:46:48.472958588 (3h6m48.062303575s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:46:48.748191913 (3h6m48.3375369s) [upload=3261]: Done uploading segments... Aug 7 12:46:48.748210889 (3h6m48.337555877s) [upload=3261]: Upload finished. err: <nil> Aug 7 12:47:51.331214594 (3h7m50.920559581s) [upload=3277]: Starting upload Aug 7 12:47:51.331250061 (3h7m50.920595048s) [upload=3277]: Done starting upload Aug 7 12:47:51.331294016 (3h7m50.920639003s) [upload=3277]: Uploading segments... Aug 7 12:47:51.331323142 (3h7m50.920668129s) [upload=3277]: Got next segment. Inline: true Aug 7 12:47:51.331326829 (3h7m50.920671816s) [upload=3277]: Waiting for error group managing segments... Aug 7 12:47:51.331358759 (3h7m50.920703747s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:51.331362577 (3h7m50.920707564s) [upload=3277]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:51.331364802 (3h7m50.920709789s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:51.603866170 (3h7m51.193211197s) [upload=3277]: Done uploading segments... Aug 7 12:47:51.603887010 (3h7m51.193231997s) [upload=3277]: Upload finished. err: <nil> Aug 7 12:48:47.521256329 (3h8m47.110601316s) [upload=3294]: Starting upload Aug 7 12:48:47.521298289 (3h8m47.110643266s) [upload=3294]: Done starting upload Aug 7 12:48:47.521349948 (3h8m47.110694935s) [upload=3294]: Uploading segments... Aug 7 12:48:47.521376278 (3h8m47.110721265s) [upload=3294]: Got next segment. Inline: true Aug 7 12:48:47.521388491 (3h8m47.110733478s) [upload=3294]: Waiting for error group managing segments... Aug 7 12:48:47.521422207 (3h8m47.110767194s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:47.521425874 (3h8m47.110770851s) [upload=3294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:47.521428128 (3h8m47.110773115s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:47.818306275 (3h8m47.407651272s) [upload=3294]: Done uploading segments... Aug 7 12:48:47.818323799 (3h8m47.407668786s) [upload=3294]: Upload finished. err: <nil> Duration: 1.81308848s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X..X...] duration: 5.873446815s FAIL (2025-08-07 12:49:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2aa44c9765be58010e96b6026bae29242674695433d542aef14e18cd2e33fdf5 != before b16832a62110b705f59475591803403afadf619b6e8c0ea43b792a83c97ba921 ======LOGS====== ommit Aug 7 12:46:21.996752862 (3h6m21.586097849s) [upload=3257]: Done uploading segments... Aug 7 12:46:21.996770766 (3h6m21.586115753s) [upload=3257]: Upload finished. err: <nil> Aug 7 12:47:31.254217874 (3h7m30.843562861s) [upload=3274]: Starting upload Aug 7 12:47:31.254262930 (3h7m30.843607917s) [upload=3274]: Done starting upload Aug 7 12:47:31.254368042 (3h7m30.843713029s) [upload=3274]: Uploading segments... Aug 7 12:47:31.254508570 (3h7m30.843853557s) [upload=3274]: Got next segment. Inline: false Aug 7 12:47:31.254536885 (3h7m30.843881872s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:31.254540962 (3h7m30.843885939s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:47:31.700161194 (3h7m31.289506181s) [seg_pos={0 0}, upload=3274]: Begin upload segment... Aug 7 12:47:31.700216349 (3h7m31.289561326s) [seg_pos={0 0}, upload=3274]: Done begin upload segment. Aug 7 12:47:31.700238542 (3h7m31.289583519s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700328965 (3h7m31.289673962s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700600114 (3h7m31.289945101s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700860020 (3h7m31.290205007s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701112513 (3h7m31.2904575s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701260938 (3h7m31.290605925s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701372471 (3h7m31.290717458s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701605567 (3h7m31.290950544s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701834484 (3h7m31.291179471s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701852670 (3h7m31.291197657s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701904178 (3h7m31.291249165s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702086177 (3h7m31.291431154s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702312359 (3h7m31.291657346s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702368517 (3h7m31.291713504s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.703374160 (3h7m31.292719147s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704353204 (3h7m31.293698191s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704892575 (3h7m31.294237562s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.705331565 (3h7m31.294676552s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:32.796060244 (3h7m32.385405231s) [upload=3274]: Next returned nil segment Aug 7 12:47:32.796077607 (3h7m32.385422584s) [upload=3274]: Waiting for error group managing segments... Aug 7 12:47:33.075187900 (3h7m32.664532887s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.075537569 (3h7m32.664882546s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.108593073 (3h7m32.69793806s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.618603580 (3h7m33.207948568s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.621934483 (3h7m33.21127947s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.645974970 (3h7m33.235319947s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.647290497 (3h7m33.236635474s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.652413307 (3h7m33.241758304s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.656977099 (3h7m33.246322086s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.701452252 (3h7m33.290797229s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.707682883 (3h7m33.29702786s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.719107932 (3h7m33.308452919s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.754880525 (3h7m33.344225512s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769832351 (3h7m33.359177339s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769857339 (3h7m33.359202326s) [seg_pos={0 0}, upload=3274]: Segment reached optimal threshold of 14 pieces. Aug 7 12:47:33.769969273 (3h7m33.359314261s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770037485 (3h7m33.359382472s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770098962 (3h7m33.359443949s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770110054 (3h7m33.359455041s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770137867 (3h7m33.359482854s) [seg_pos={0 0}, upload=3274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:47:33.770202731 (3h7m33.359547718s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:47:33.770208171 (3h7m33.359553158s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:34.068591549 (3h7m33.657936536s) [upload=3274]: Done uploading segments... Aug 7 12:47:34.068615775 (3h7m33.657960763s) [upload=3274]: Upload finished. err: <nil> Duration: 5.873469168s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [........X.........X........................X........X.....X.] duration: 1.87699036s FAIL (2025-08-07 12:49:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== questItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Aug 7 12:43:59.139566359 (3h3m58.728911346s) [upload=3215]: Starting upload Aug 7 12:43:59.139626314 (3h3m58.728971301s) [upload=3215]: Done starting upload Aug 7 12:43:59.139692420 (3h3m58.729037407s) [upload=3215]: Uploading segments... Aug 7 12:43:59.139812500 (3h3m58.729157487s) [upload=3215]: Got next segment. Inline: true Aug 7 12:43:59.139817600 (3h3m58.729162587s) [upload=3215]: Waiting for error group managing segments... Aug 7 12:43:59.139857276 (3h3m58.729202253s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:59.139862095 (3h3m58.729207082s) [upload=3215]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:59.139864649 (3h3m58.729209637s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:59.420568172 (3h3m59.009913169s) [upload=3215]: Done uploading segments... Aug 7 12:43:59.420591957 (3h3m59.009936974s) [upload=3215]: Upload finished. err: <nil> Aug 7 12:44:51.641577950 (3h4m51.230922927s) [upload=3230]: Starting upload Aug 7 12:44:51.641637654 (3h4m51.230982641s) [upload=3230]: Done starting upload Aug 7 12:44:51.641703038 (3h4m51.231048015s) [upload=3230]: Uploading segments... Aug 7 12:44:51.641752433 (3h4m51.23109742s) [upload=3230]: Got next segment. Inline: true Aug 7 12:44:51.641756501 (3h4m51.231101488s) [upload=3230]: Waiting for error group managing segments... Aug 7 12:44:51.641834660 (3h4m51.231179647s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:44:51.641850782 (3h4m51.231195769s) [upload=3230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:44:51.641853176 (3h4m51.231198153s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:44:52.045684554 (3h4m51.635029541s) [upload=3230]: Done uploading segments... Aug 7 12:44:52.045704021 (3h4m51.635049009s) [upload=3230]: Upload finished. err: <nil> Aug 7 12:45:36.266044075 (3h5m35.855389062s) [upload=3244]: Starting upload Aug 7 12:45:36.266095454 (3h5m35.855440431s) [upload=3244]: Done starting upload Aug 7 12:45:36.266148726 (3h5m35.855493713s) [upload=3244]: Uploading segments... Aug 7 12:45:36.266178563 (3h5m35.85552355s) [upload=3244]: Got next segment. Inline: true Aug 7 12:45:36.266182109 (3h5m35.855527086s) [upload=3244]: Waiting for error group managing segments... Aug 7 12:45:36.266214812 (3h5m35.855559799s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:45:36.266218329 (3h5m35.855563316s) [upload=3244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:45:36.266223980 (3h5m35.855568957s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:45:36.538124018 (3h5m36.127469025s) [upload=3244]: Done uploading segments... Aug 7 12:45:36.538142734 (3h5m36.127487711s) [upload=3244]: Upload finished. err: <nil> Aug 7 12:46:48.472789014 (3h6m48.062133991s) [upload=3261]: Starting upload Aug 7 12:46:48.472826775 (3h6m48.062171762s) [upload=3261]: Done starting upload Aug 7 12:46:48.472885838 (3h6m48.062230825s) [upload=3261]: Uploading segments... Aug 7 12:46:48.472917008 (3h6m48.062261995s) [upload=3261]: Got next segment. Inline: true Aug 7 12:46:48.472920465 (3h6m48.062265442s) [upload=3261]: Waiting for error group managing segments... Aug 7 12:46:48.472952817 (3h6m48.062297804s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:46:48.472956283 (3h6m48.062301271s) [upload=3261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:46:48.472958588 (3h6m48.062303575s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:46:48.748191913 (3h6m48.3375369s) [upload=3261]: Done uploading segments... Aug 7 12:46:48.748210889 (3h6m48.337555877s) [upload=3261]: Upload finished. err: <nil> Aug 7 12:47:51.331214594 (3h7m50.920559581s) [upload=3277]: Starting upload Aug 7 12:47:51.331250061 (3h7m50.920595048s) [upload=3277]: Done starting upload Aug 7 12:47:51.331294016 (3h7m50.920639003s) [upload=3277]: Uploading segments... Aug 7 12:47:51.331323142 (3h7m50.920668129s) [upload=3277]: Got next segment. Inline: true Aug 7 12:47:51.331326829 (3h7m50.920671816s) [upload=3277]: Waiting for error group managing segments... Aug 7 12:47:51.331358759 (3h7m50.920703747s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:51.331362577 (3h7m50.920707564s) [upload=3277]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:51.331364802 (3h7m50.920709789s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:51.603866170 (3h7m51.193211197s) [upload=3277]: Done uploading segments... Aug 7 12:47:51.603887010 (3h7m51.193231997s) [upload=3277]: Upload finished. err: <nil> Aug 7 12:48:47.521256329 (3h8m47.110601316s) [upload=3294]: Starting upload Aug 7 12:48:47.521298289 (3h8m47.110643266s) [upload=3294]: Done starting upload Aug 7 12:48:47.521349948 (3h8m47.110694935s) [upload=3294]: Uploading segments... Aug 7 12:48:47.521376278 (3h8m47.110721265s) [upload=3294]: Got next segment. Inline: true Aug 7 12:48:47.521388491 (3h8m47.110733478s) [upload=3294]: Waiting for error group managing segments... Aug 7 12:48:47.521422207 (3h8m47.110767194s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:47.521425874 (3h8m47.110770851s) [upload=3294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:47.521428128 (3h8m47.110773115s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:47.818306275 (3h8m47.407651272s) [upload=3294]: Done uploading segments... Aug 7 12:48:47.818323799 (3h8m47.407668786s) [upload=3294]: Upload finished. err: <nil> Duration: 1.877019386s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X..X..] duration: 5.701026928s FAIL (2025-08-07 12:49:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2aa44c9765be58010e96b6026bae29242674695433d542aef14e18cd2e33fdf5 != before b16832a62110b705f59475591803403afadf619b6e8c0ea43b792a83c97ba921 ======LOGS====== ommit Aug 7 12:46:21.996752862 (3h6m21.586097849s) [upload=3257]: Done uploading segments... Aug 7 12:46:21.996770766 (3h6m21.586115753s) [upload=3257]: Upload finished. err: <nil> Aug 7 12:47:31.254217874 (3h7m30.843562861s) [upload=3274]: Starting upload Aug 7 12:47:31.254262930 (3h7m30.843607917s) [upload=3274]: Done starting upload Aug 7 12:47:31.254368042 (3h7m30.843713029s) [upload=3274]: Uploading segments... Aug 7 12:47:31.254508570 (3h7m30.843853557s) [upload=3274]: Got next segment. Inline: false Aug 7 12:47:31.254536885 (3h7m30.843881872s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:31.254540962 (3h7m30.843885939s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:47:31.700161194 (3h7m31.289506181s) [seg_pos={0 0}, upload=3274]: Begin upload segment... Aug 7 12:47:31.700216349 (3h7m31.289561326s) [seg_pos={0 0}, upload=3274]: Done begin upload segment. Aug 7 12:47:31.700238542 (3h7m31.289583519s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700328965 (3h7m31.289673962s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700600114 (3h7m31.289945101s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700860020 (3h7m31.290205007s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701112513 (3h7m31.2904575s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701260938 (3h7m31.290605925s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701372471 (3h7m31.290717458s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701605567 (3h7m31.290950544s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701834484 (3h7m31.291179471s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701852670 (3h7m31.291197657s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701904178 (3h7m31.291249165s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702086177 (3h7m31.291431154s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702312359 (3h7m31.291657346s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702368517 (3h7m31.291713504s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.703374160 (3h7m31.292719147s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704353204 (3h7m31.293698191s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704892575 (3h7m31.294237562s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.705331565 (3h7m31.294676552s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:32.796060244 (3h7m32.385405231s) [upload=3274]: Next returned nil segment Aug 7 12:47:32.796077607 (3h7m32.385422584s) [upload=3274]: Waiting for error group managing segments... Aug 7 12:47:33.075187900 (3h7m32.664532887s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.075537569 (3h7m32.664882546s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.108593073 (3h7m32.69793806s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.618603580 (3h7m33.207948568s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.621934483 (3h7m33.21127947s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.645974970 (3h7m33.235319947s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.647290497 (3h7m33.236635474s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.652413307 (3h7m33.241758304s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.656977099 (3h7m33.246322086s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.701452252 (3h7m33.290797229s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.707682883 (3h7m33.29702786s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.719107932 (3h7m33.308452919s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.754880525 (3h7m33.344225512s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769832351 (3h7m33.359177339s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769857339 (3h7m33.359202326s) [seg_pos={0 0}, upload=3274]: Segment reached optimal threshold of 14 pieces. Aug 7 12:47:33.769969273 (3h7m33.359314261s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770037485 (3h7m33.359382472s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770098962 (3h7m33.359443949s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770110054 (3h7m33.359455041s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770137867 (3h7m33.359482854s) [seg_pos={0 0}, upload=3274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:47:33.770202731 (3h7m33.359547718s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:47:33.770208171 (3h7m33.359553158s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:34.068591549 (3h7m33.657936536s) [upload=3274]: Done uploading segments... Aug 7 12:47:34.068615775 (3h7m33.657960763s) [upload=3274]: Upload finished. err: <nil> Duration: 5.701056455s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........X.........X........................X........X.....X] duration: 1.604911377s FAIL (2025-08-07 12:48:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== questItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Aug 7 12:43:59.139566359 (3h3m58.728911346s) [upload=3215]: Starting upload Aug 7 12:43:59.139626314 (3h3m58.728971301s) [upload=3215]: Done starting upload Aug 7 12:43:59.139692420 (3h3m58.729037407s) [upload=3215]: Uploading segments... Aug 7 12:43:59.139812500 (3h3m58.729157487s) [upload=3215]: Got next segment. Inline: true Aug 7 12:43:59.139817600 (3h3m58.729162587s) [upload=3215]: Waiting for error group managing segments... Aug 7 12:43:59.139857276 (3h3m58.729202253s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:59.139862095 (3h3m58.729207082s) [upload=3215]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:59.139864649 (3h3m58.729209637s) [upload=3215]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:59.420568172 (3h3m59.009913169s) [upload=3215]: Done uploading segments... Aug 7 12:43:59.420591957 (3h3m59.009936974s) [upload=3215]: Upload finished. err: <nil> Aug 7 12:44:51.641577950 (3h4m51.230922927s) [upload=3230]: Starting upload Aug 7 12:44:51.641637654 (3h4m51.230982641s) [upload=3230]: Done starting upload Aug 7 12:44:51.641703038 (3h4m51.231048015s) [upload=3230]: Uploading segments... Aug 7 12:44:51.641752433 (3h4m51.23109742s) [upload=3230]: Got next segment. Inline: true Aug 7 12:44:51.641756501 (3h4m51.231101488s) [upload=3230]: Waiting for error group managing segments... Aug 7 12:44:51.641834660 (3h4m51.231179647s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:44:51.641850782 (3h4m51.231195769s) [upload=3230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:44:51.641853176 (3h4m51.231198153s) [upload=3230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:44:52.045684554 (3h4m51.635029541s) [upload=3230]: Done uploading segments... Aug 7 12:44:52.045704021 (3h4m51.635049009s) [upload=3230]: Upload finished. err: <nil> Aug 7 12:45:36.266044075 (3h5m35.855389062s) [upload=3244]: Starting upload Aug 7 12:45:36.266095454 (3h5m35.855440431s) [upload=3244]: Done starting upload Aug 7 12:45:36.266148726 (3h5m35.855493713s) [upload=3244]: Uploading segments... Aug 7 12:45:36.266178563 (3h5m35.85552355s) [upload=3244]: Got next segment. Inline: true Aug 7 12:45:36.266182109 (3h5m35.855527086s) [upload=3244]: Waiting for error group managing segments... Aug 7 12:45:36.266214812 (3h5m35.855559799s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:45:36.266218329 (3h5m35.855563316s) [upload=3244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:45:36.266223980 (3h5m35.855568957s) [upload=3244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:45:36.538124018 (3h5m36.127469025s) [upload=3244]: Done uploading segments... Aug 7 12:45:36.538142734 (3h5m36.127487711s) [upload=3244]: Upload finished. err: <nil> Aug 7 12:46:48.472789014 (3h6m48.062133991s) [upload=3261]: Starting upload Aug 7 12:46:48.472826775 (3h6m48.062171762s) [upload=3261]: Done starting upload Aug 7 12:46:48.472885838 (3h6m48.062230825s) [upload=3261]: Uploading segments... Aug 7 12:46:48.472917008 (3h6m48.062261995s) [upload=3261]: Got next segment. Inline: true Aug 7 12:46:48.472920465 (3h6m48.062265442s) [upload=3261]: Waiting for error group managing segments... Aug 7 12:46:48.472952817 (3h6m48.062297804s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:46:48.472956283 (3h6m48.062301271s) [upload=3261]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:46:48.472958588 (3h6m48.062303575s) [upload=3261]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:46:48.748191913 (3h6m48.3375369s) [upload=3261]: Done uploading segments... Aug 7 12:46:48.748210889 (3h6m48.337555877s) [upload=3261]: Upload finished. err: <nil> Aug 7 12:47:51.331214594 (3h7m50.920559581s) [upload=3277]: Starting upload Aug 7 12:47:51.331250061 (3h7m50.920595048s) [upload=3277]: Done starting upload Aug 7 12:47:51.331294016 (3h7m50.920639003s) [upload=3277]: Uploading segments... Aug 7 12:47:51.331323142 (3h7m50.920668129s) [upload=3277]: Got next segment. Inline: true Aug 7 12:47:51.331326829 (3h7m50.920671816s) [upload=3277]: Waiting for error group managing segments... Aug 7 12:47:51.331358759 (3h7m50.920703747s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:51.331362577 (3h7m50.920707564s) [upload=3277]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:47:51.331364802 (3h7m50.920709789s) [upload=3277]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:51.603866170 (3h7m51.193211197s) [upload=3277]: Done uploading segments... Aug 7 12:47:51.603887010 (3h7m51.193231997s) [upload=3277]: Upload finished. err: <nil> Aug 7 12:48:47.521256329 (3h8m47.110601316s) [upload=3294]: Starting upload Aug 7 12:48:47.521298289 (3h8m47.110643266s) [upload=3294]: Done starting upload Aug 7 12:48:47.521349948 (3h8m47.110694935s) [upload=3294]: Uploading segments... Aug 7 12:48:47.521376278 (3h8m47.110721265s) [upload=3294]: Got next segment. Inline: true Aug 7 12:48:47.521388491 (3h8m47.110733478s) [upload=3294]: Waiting for error group managing segments... Aug 7 12:48:47.521422207 (3h8m47.110767194s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:48:47.521425874 (3h8m47.110770851s) [upload=3294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:48:47.521428128 (3h8m47.110773115s) [upload=3294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:48:47.818306275 (3h8m47.407651272s) [upload=3294]: Done uploading segments... Aug 7 12:48:47.818323799 (3h8m47.407668786s) [upload=3294]: Upload finished. err: <nil> Duration: 1.604936895s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X..X.] duration: 5.841992953s FAIL (2025-08-07 12:48:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2aa44c9765be58010e96b6026bae29242674695433d542aef14e18cd2e33fdf5 != before b16832a62110b705f59475591803403afadf619b6e8c0ea43b792a83c97ba921 ======LOGS====== ommit Aug 7 12:46:21.996752862 (3h6m21.586097849s) [upload=3257]: Done uploading segments... Aug 7 12:46:21.996770766 (3h6m21.586115753s) [upload=3257]: Upload finished. err: <nil> Aug 7 12:47:31.254217874 (3h7m30.843562861s) [upload=3274]: Starting upload Aug 7 12:47:31.254262930 (3h7m30.843607917s) [upload=3274]: Done starting upload Aug 7 12:47:31.254368042 (3h7m30.843713029s) [upload=3274]: Uploading segments... Aug 7 12:47:31.254508570 (3h7m30.843853557s) [upload=3274]: Got next segment. Inline: false Aug 7 12:47:31.254536885 (3h7m30.843881872s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:31.254540962 (3h7m30.843885939s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:47:31.700161194 (3h7m31.289506181s) [seg_pos={0 0}, upload=3274]: Begin upload segment... Aug 7 12:47:31.700216349 (3h7m31.289561326s) [seg_pos={0 0}, upload=3274]: Done begin upload segment. Aug 7 12:47:31.700238542 (3h7m31.289583519s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700328965 (3h7m31.289673962s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700600114 (3h7m31.289945101s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700860020 (3h7m31.290205007s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701112513 (3h7m31.2904575s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701260938 (3h7m31.290605925s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701372471 (3h7m31.290717458s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701605567 (3h7m31.290950544s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701834484 (3h7m31.291179471s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701852670 (3h7m31.291197657s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701904178 (3h7m31.291249165s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702086177 (3h7m31.291431154s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702312359 (3h7m31.291657346s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702368517 (3h7m31.291713504s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.703374160 (3h7m31.292719147s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704353204 (3h7m31.293698191s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704892575 (3h7m31.294237562s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.705331565 (3h7m31.294676552s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:32.796060244 (3h7m32.385405231s) [upload=3274]: Next returned nil segment Aug 7 12:47:32.796077607 (3h7m32.385422584s) [upload=3274]: Waiting for error group managing segments... Aug 7 12:47:33.075187900 (3h7m32.664532887s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.075537569 (3h7m32.664882546s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.108593073 (3h7m32.69793806s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.618603580 (3h7m33.207948568s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.621934483 (3h7m33.21127947s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.645974970 (3h7m33.235319947s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.647290497 (3h7m33.236635474s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.652413307 (3h7m33.241758304s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.656977099 (3h7m33.246322086s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.701452252 (3h7m33.290797229s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.707682883 (3h7m33.29702786s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.719107932 (3h7m33.308452919s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.754880525 (3h7m33.344225512s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769832351 (3h7m33.359177339s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769857339 (3h7m33.359202326s) [seg_pos={0 0}, upload=3274]: Segment reached optimal threshold of 14 pieces. Aug 7 12:47:33.769969273 (3h7m33.359314261s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770037485 (3h7m33.359382472s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770098962 (3h7m33.359443949s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770110054 (3h7m33.359455041s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770137867 (3h7m33.359482854s) [seg_pos={0 0}, upload=3274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:47:33.770202731 (3h7m33.359547718s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:47:33.770208171 (3h7m33.359553158s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:34.068591549 (3h7m33.657936536s) [upload=3274]: Done uploading segments... Aug 7 12:47:34.068615775 (3h7m33.657960763s) [upload=3274]: Upload finished. err: <nil> Duration: 5.842011829s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X.........X........................X........X.....] duration: 1.826595499s FAIL (2025-08-07 12:47:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 04d0ad23c1dca8101bf835aa4987fd0b5bc13256284ff67d5ed6d9d923e304ab != before 280046d3788d8f2fbaada4dddb492f449037123edff3b4b3c36deababf8b9372 ======LOGS====== 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Aug 7 12:38:41.966251404 (2h58m41.555596391s) [upload=3114]: Starting upload Aug 7 12:38:41.966300308 (2h58m41.555645285s) [upload=3114]: Done starting upload Aug 7 12:38:41.966349633 (2h58m41.55569462s) [upload=3114]: Uploading segments... Aug 7 12:38:41.966378308 (2h58m41.555723285s) [upload=3114]: Got next segment. Inline: true Aug 7 12:38:41.966381914 (2h58m41.555726901s) [upload=3114]: Waiting for error group managing segments... Aug 7 12:38:41.966414186 (2h58m41.555759173s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:41.966418334 (2h58m41.555763321s) [upload=3114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:41.966420809 (2h58m41.555765786s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:42.281004521 (2h58m41.870349518s) [upload=3114]: Done uploading segments... Aug 7 12:38:42.281026093 (2h58m41.87037108s) [upload=3114]: Upload finished. err: <nil> Aug 7 12:39:19.370352705 (2h59m18.959697692s) [upload=3126]: Starting upload Aug 7 12:39:19.370398824 (2h59m18.959743811s) [upload=3126]: Done starting upload Aug 7 12:39:19.370449962 (2h59m18.959794939s) [upload=3126]: Uploading segments... Aug 7 12:39:19.370482203 (2h59m18.95982718s) [upload=3126]: Got next segment. Inline: true Aug 7 12:39:19.370485850 (2h59m18.959830837s) [upload=3126]: Waiting for error group managing segments... Aug 7 12:39:19.370518462 (2h59m18.959863449s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:19.370522750 (2h59m18.959867737s) [upload=3126]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:19.370524854 (2h59m18.959869841s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:19.645497369 (2h59m19.234842356s) [upload=3126]: Done uploading segments... Aug 7 12:39:19.645515023 (2h59m19.23486s) [upload=3126]: Upload finished. err: <nil> Aug 7 12:39:51.464710987 (2h59m51.054055974s) [upload=3136]: Starting upload Aug 7 12:39:51.464768887 (2h59m51.054113874s) [upload=3136]: Done starting upload Aug 7 12:39:51.464813904 (2h59m51.054158891s) [upload=3136]: Uploading segments... Aug 7 12:39:51.464844192 (2h59m51.054189179s) [upload=3136]: Got next segment. Inline: true Aug 7 12:39:51.464847828 (2h59m51.054192815s) [upload=3136]: Waiting for error group managing segments... Aug 7 12:39:51.464884107 (2h59m51.054229095s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:51.464888025 (2h59m51.054233012s) [upload=3136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:51.464890410 (2h59m51.054235397s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:51.743251199 (2h59m51.332596176s) [upload=3136]: Done uploading segments... Aug 7 12:39:51.743267881 (2h59m51.332612868s) [upload=3136]: Upload finished. err: <nil> Aug 7 12:40:08.156888598 (3h0m7.746233585s) [upload=3141]: Starting upload Aug 7 12:40:08.156936880 (3h0m7.746281867s) [upload=3141]: Done starting upload Aug 7 12:40:08.157031731 (3h0m7.746376718s) [upload=3141]: Uploading segments... Aug 7 12:40:08.157136983 (3h0m7.74648197s) [upload=3141]: Got next segment. Inline: true Aug 7 12:40:08.157142563 (3h0m7.74648755s) [upload=3141]: Waiting for error group managing segments... Aug 7 12:40:08.157185015 (3h0m7.746529992s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:40:08.157191126 (3h0m7.746536113s) [upload=3141]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:40:08.157193541 (3h0m7.746538528s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:40:08.434339995 (3h0m8.023684982s) [upload=3141]: Done uploading segments... Aug 7 12:40:08.434360715 (3h0m8.023705702s) [upload=3141]: Upload finished. err: <nil> Aug 7 12:41:14.906198200 (3h1m14.495543187s) [upload=3161]: Starting upload Aug 7 12:41:14.906248987 (3h1m14.495593974s) [upload=3161]: Done starting upload Aug 7 12:41:14.906301908 (3h1m14.495646885s) [upload=3161]: Uploading segments... Aug 7 12:41:14.906339159 (3h1m14.495684146s) [upload=3161]: Got next segment. Inline: true Aug 7 12:41:14.906343557 (3h1m14.495688544s) [upload=3161]: Waiting for error group managing segments... Aug 7 12:41:14.906376871 (3h1m14.495721858s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Duration: 1.826632089s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X..X] duration: 5.61752082s FAIL (2025-08-07 12:47:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2aa44c9765be58010e96b6026bae29242674695433d542aef14e18cd2e33fdf5 != before b16832a62110b705f59475591803403afadf619b6e8c0ea43b792a83c97ba921 ======LOGS====== ommit Aug 7 12:46:21.996752862 (3h6m21.586097849s) [upload=3257]: Done uploading segments... Aug 7 12:46:21.996770766 (3h6m21.586115753s) [upload=3257]: Upload finished. err: <nil> Aug 7 12:47:31.254217874 (3h7m30.843562861s) [upload=3274]: Starting upload Aug 7 12:47:31.254262930 (3h7m30.843607917s) [upload=3274]: Done starting upload Aug 7 12:47:31.254368042 (3h7m30.843713029s) [upload=3274]: Uploading segments... Aug 7 12:47:31.254508570 (3h7m30.843853557s) [upload=3274]: Got next segment. Inline: false Aug 7 12:47:31.254536885 (3h7m30.843881872s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:47:31.254540962 (3h7m30.843885939s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:47:31.700161194 (3h7m31.289506181s) [seg_pos={0 0}, upload=3274]: Begin upload segment... Aug 7 12:47:31.700216349 (3h7m31.289561326s) [seg_pos={0 0}, upload=3274]: Done begin upload segment. Aug 7 12:47:31.700238542 (3h7m31.289583519s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700328965 (3h7m31.289673962s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700600114 (3h7m31.289945101s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.700860020 (3h7m31.290205007s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701112513 (3h7m31.2904575s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701260938 (3h7m31.290605925s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701372471 (3h7m31.290717458s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701605567 (3h7m31.290950544s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701834484 (3h7m31.291179471s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701852670 (3h7m31.291197657s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.701904178 (3h7m31.291249165s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702086177 (3h7m31.291431154s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702312359 (3h7m31.291657346s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.702368517 (3h7m31.291713504s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.703374160 (3h7m31.292719147s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704353204 (3h7m31.293698191s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.704892575 (3h7m31.294237562s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:31.705331565 (3h7m31.294676552s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Uploading piece... Aug 7 12:47:32.796060244 (3h7m32.385405231s) [upload=3274]: Next returned nil segment Aug 7 12:47:32.796077607 (3h7m32.385422584s) [upload=3274]: Waiting for error group managing segments... Aug 7 12:47:33.075187900 (3h7m32.664532887s) [noise=true , address=64.49.13.170:4722 , piece_id=KRMRO47P5JT2ZNPLKCKHUANSCIU7W2TB3MXNOVIE2OGFPGMPONNA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.075537569 (3h7m32.664882546s) [noise=true , address=64.49.13.139:4469 , piece_id=WIIRQIR5EXKAI4VGNVRL2GTYZW5SAY4CWBOLOUXUA6WZIEF7GMEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.108593073 (3h7m32.69793806s) [noise=true , address=64.49.13.27:4959 , piece_id=RJKIAE27QV3NCFSR4MFYKOHYIJUND4H3IHWUGE5GOR6F26EFG53Q, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.618603580 (3h7m33.207948568s) [noise=true , address=104.36.82.2:4754 , piece_id=KCNQAN36MCXZRQJMHIV5UZQTW3Q3WDIZFH2JRRTLV2DZ6XATFKEQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.621934483 (3h7m33.21127947s) [noise=true , address=104.36.82.38:4721 , piece_id=5ZYV4BJ45EYXZP7UT4VJ6SZI4DOA3IBQMO3G7UDSHLD7BCFEVOGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.645974970 (3h7m33.235319947s) [noise=true , address=104.36.82.53:4151 , piece_id=WCL6JXDPRV3LNCHKSTSAZK5YWHR26LHTAPWUVYH7CQFDDRQA25GA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.647290497 (3h7m33.236635474s) [noise=true , address=104.36.82.8:4995 , piece_id=F33LXFWI5DDSPCFW35FIBZZ5VDVHSWEUYREG6PCJYNMEPHN5HENQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.652413307 (3h7m33.241758304s) [noise=true , address=104.36.82.61:4376 , piece_id=6UVINYK2EV7C2E5M5TYJGEZ42KD2QCNZBVZIUTPVM67WGQBFUYHA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.656977099 (3h7m33.246322086s) [noise=true , address=104.36.82.46:4514 , piece_id=U7LRLW3LYSW5ZZI2I3XDLK7WEU25ZNSQYTBPTWV7GJWOFKQGO7UA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.701452252 (3h7m33.290797229s) [noise=true , address=104.36.82.15:4275 , piece_id=ZCIGZZQJY7MFP2QCRWA5SNRBCLIY2P4GMENVAJJSYYBFAAHZLWGA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.707682883 (3h7m33.29702786s) [noise=true , address=104.36.82.7:4926 , piece_id=FHIGZTYISALMNJZ4M24DZR54VPCUOOS7KRSXISAUZCXIKPYEPOEA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.719107932 (3h7m33.308452919s) [noise=true , address=104.36.82.5:4845 , piece_id=6R6BTNM7JFH7KY4UGIU3FWUSVGYJKUUEHFRRKZXBAA3SN6GTT6TQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.754880525 (3h7m33.344225512s) [noise=true , address=104.36.82.58:4295 , piece_id=OM4NKJIAU2VQ3CQU6BPPRV5KUD6MQQID6OTAPAWM2HCT4VYVJHCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769832351 (3h7m33.359177339s) [noise=true , address=104.36.82.37:4668 , piece_id=NYTC3SODUDLCI7PNIHQA6TQAIS4MCCZ6MURATDSXTZI2224OPGCQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: <nil> Aug 7 12:47:33.769857339 (3h7m33.359202326s) [seg_pos={0 0}, upload=3274]: Segment reached optimal threshold of 14 pieces. Aug 7 12:47:33.769969273 (3h7m33.359314261s) [noise=true , address=104.36.82.44:4900 , piece_id=YBDJ3TSWC3I6EI56OGCIHK7TD53CMNVUOH6RUW4LELQYTGNZ2GCA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1R8K65zsCspu7W2oAnvtpz7zEsQFkDG1e5BAp6faQYMQrkh4oQ): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770037485 (3h7m33.359382472s) [noise=true , address=104.36.82.59:4306 , piece_id=3NDH7EGNPN5FTOGXCXSWGUGHX5REL4WYVSPAIIFILOUA3BIWQAGQ, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12amBPo7WKpjPDzi6mUWw5PcdgrcT7hsUjsSkijfrvKka1bJzNw): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770098962 (3h7m33.359443949s) [noise=true , address=104.36.82.47:4526 , piece_id=R5U6T7OBKCSUAIKKMDE53X3S47SQEHEKDVWPPKVAJY2DLTFRKCBA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770110054 (3h7m33.359455041s) [noise=true , address=104.36.82.23:4469 , piece_id=VPDQDKIR5FIKT2D4UGRCLCCU4R7TKSVLFGMAIACDM23IKM2MXNVA, seg_pos={0 0}, upload=3274]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: expected piece hash; context canceled; EOF Aug 7 12:47:33.770137867 (3h7m33.359482854s) [seg_pos={0 0}, upload=3274]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:47:33.770202731 (3h7m33.359547718s) [upload=3274]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:47:33.770208171 (3h7m33.359553158s) [upload=3274]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:47:34.068591549 (3h7m33.657936536s) [upload=3274]: Done uploading segments... Aug 7 12:47:34.068615775 (3h7m33.657960763s) [upload=3274]: Upload finished. err: <nil> Duration: 5.617535616s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........X.........X........................X........X....] duration: 1.842478977s FAIL (2025-08-07 12:46:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 04d0ad23c1dca8101bf835aa4987fd0b5bc13256284ff67d5ed6d9d923e304ab != before 280046d3788d8f2fbaada4dddb492f449037123edff3b4b3c36deababf8b9372 ======LOGS====== 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Aug 7 12:38:41.966251404 (2h58m41.555596391s) [upload=3114]: Starting upload Aug 7 12:38:41.966300308 (2h58m41.555645285s) [upload=3114]: Done starting upload Aug 7 12:38:41.966349633 (2h58m41.55569462s) [upload=3114]: Uploading segments... Aug 7 12:38:41.966378308 (2h58m41.555723285s) [upload=3114]: Got next segment. Inline: true Aug 7 12:38:41.966381914 (2h58m41.555726901s) [upload=3114]: Waiting for error group managing segments... Aug 7 12:38:41.966414186 (2h58m41.555759173s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:41.966418334 (2h58m41.555763321s) [upload=3114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:41.966420809 (2h58m41.555765786s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:42.281004521 (2h58m41.870349518s) [upload=3114]: Done uploading segments... Aug 7 12:38:42.281026093 (2h58m41.87037108s) [upload=3114]: Upload finished. err: <nil> Aug 7 12:39:19.370352705 (2h59m18.959697692s) [upload=3126]: Starting upload Aug 7 12:39:19.370398824 (2h59m18.959743811s) [upload=3126]: Done starting upload Aug 7 12:39:19.370449962 (2h59m18.959794939s) [upload=3126]: Uploading segments... Aug 7 12:39:19.370482203 (2h59m18.95982718s) [upload=3126]: Got next segment. Inline: true Aug 7 12:39:19.370485850 (2h59m18.959830837s) [upload=3126]: Waiting for error group managing segments... Aug 7 12:39:19.370518462 (2h59m18.959863449s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:19.370522750 (2h59m18.959867737s) [upload=3126]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:19.370524854 (2h59m18.959869841s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:19.645497369 (2h59m19.234842356s) [upload=3126]: Done uploading segments... Aug 7 12:39:19.645515023 (2h59m19.23486s) [upload=3126]: Upload finished. err: <nil> Aug 7 12:39:51.464710987 (2h59m51.054055974s) [upload=3136]: Starting upload Aug 7 12:39:51.464768887 (2h59m51.054113874s) [upload=3136]: Done starting upload Aug 7 12:39:51.464813904 (2h59m51.054158891s) [upload=3136]: Uploading segments... Aug 7 12:39:51.464844192 (2h59m51.054189179s) [upload=3136]: Got next segment. Inline: true Aug 7 12:39:51.464847828 (2h59m51.054192815s) [upload=3136]: Waiting for error group managing segments... Aug 7 12:39:51.464884107 (2h59m51.054229095s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:51.464888025 (2h59m51.054233012s) [upload=3136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:51.464890410 (2h59m51.054235397s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:51.743251199 (2h59m51.332596176s) [upload=3136]: Done uploading segments... Aug 7 12:39:51.743267881 (2h59m51.332612868s) [upload=3136]: Upload finished. err: <nil> Aug 7 12:40:08.156888598 (3h0m7.746233585s) [upload=3141]: Starting upload Aug 7 12:40:08.156936880 (3h0m7.746281867s) [upload=3141]: Done starting upload Aug 7 12:40:08.157031731 (3h0m7.746376718s) [upload=3141]: Uploading segments... Aug 7 12:40:08.157136983 (3h0m7.74648197s) [upload=3141]: Got next segment. Inline: true Aug 7 12:40:08.157142563 (3h0m7.74648755s) [upload=3141]: Waiting for error group managing segments... Aug 7 12:40:08.157185015 (3h0m7.746529992s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:40:08.157191126 (3h0m7.746536113s) [upload=3141]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:40:08.157193541 (3h0m7.746538528s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:40:08.434339995 (3h0m8.023684982s) [upload=3141]: Done uploading segments... Aug 7 12:40:08.434360715 (3h0m8.023705702s) [upload=3141]: Upload finished. err: <nil> Aug 7 12:41:14.906198200 (3h1m14.495543187s) [upload=3161]: Starting upload Aug 7 12:41:14.906248987 (3h1m14.495593974s) [upload=3161]: Done starting upload Aug 7 12:41:14.906301908 (3h1m14.495646885s) [upload=3161]: Uploading segments... Aug 7 12:41:14.906339159 (3h1m14.495684146s) [upload=3161]: Got next segment. Inline: true Aug 7 12:41:14.906343557 (3h1m14.495688544s) [upload=3161]: Waiting for error group managing segments... Aug 7 12:41:14.906376871 (3h1m14.495721858s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Duration: 1.842495219s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.96413143s FAIL (2025-08-07 12:46:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Commit Aug 7 12:43:31.850361795 (3h3m31.439706782s) [upload=3207]: Done uploading segments... Aug 7 12:43:31.850381663 (3h3m31.43972665s) [upload=3207]: Upload finished. err: <nil> Aug 7 12:44:41.569452026 (3h4m41.158797013s) [upload=3227]: Starting upload Aug 7 12:44:41.569495419 (3h4m41.158840406s) [upload=3227]: Done starting upload Aug 7 12:44:41.569663952 (3h4m41.159008989s) [upload=3227]: Uploading segments... Aug 7 12:44:41.569767339 (3h4m41.159112326s) [upload=3227]: Got next segment. Inline: false Aug 7 12:44:41.569827344 (3h4m41.159172331s) [upload=3227]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:44:41.569831713 (3h4m41.1591767s) [upload=3227]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:44:42.056678863 (3h4m41.64602385s) [seg_pos={0 0}, upload=3227]: Begin upload segment... Aug 7 12:44:42.056728047 (3h4m41.646073034s) [seg_pos={0 0}, upload=3227]: Done begin upload segment. Aug 7 12:44:42.056748837 (3h4m41.646093824s) [noise=true , address=104.36.82.46:4493 , piece_id=CGRVETEEYIJETV2IPBDWGRGCZ6RP3MX52ESOOQLX5OWRZCBZTIDQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057250927 (3h4m41.646595914s) [noise=true , address=104.36.82.47:4534 , piece_id=IXLQ6NCO4Y3R6R3QO3GQ63FYA2PH5FVYWT67OMMYRFEKFQMHBEJA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057557604 (3h4m41.646902591s) [noise=true , address=104.36.82.14:4256 , piece_id=SJ4NF3P2LAHCLHVGVM46VKJUYZX7UKWE3UCGH7MH5ELU7LL6WRKQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057875833 (3h4m41.64722082s) [noise=true , address=104.36.82.38:4691 , piece_id=C6EJDEYHTXN2N3C7NMN26463TWBJ5YYGIJ64QRGEHLLXXTJYVFGQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057884800 (3h4m41.647229777s) [noise=true , address=45.91.116.8:4051 , piece_id=HPS3KTRPFBICO3OLCMRSPZTSALHGWZUKCYVNHMBURE7V4AHYTX7Q, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058180436 (3h4m41.647525423s) [noise=true , address=104.36.82.13:4213 , piece_id=K5V5LSO5WDRTRZVOWVU4Z62BU4DWYODHT7HKSIIF3ZY5TPK43HGA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058208089 (3h4m41.647553076s) [noise=true , address=64.49.13.170:4728 , piece_id=ATO77ZWTN4SN5HFWBXPWFGIK66RSULTGBWDQRGL5MDA7X7S2HNGA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058469589 (3h4m41.647814566s) [noise=true , address=104.36.82.58:4295 , piece_id=CKY6LZBUWAHMGAKKEQIH5XV7IPAWWB7JCHYSHL36DU56ZMYYXTKQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058810582 (3h4m41.648155569s) [noise=true , address=45.91.116.5:4322 , piece_id=2HLDBCJ3YWJMJWQ2JP2JMI3YXKM4DB44IEEA56E7UBZTQJKRAQVQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059158306 (3h4m41.648503283s) [noise=true , address=104.36.82.61:4373 , piece_id=FJD4XPWXSSKXMIG6CQVAXCBKVVZA4NO62RHYFPAZGGREQZMC66OQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059393156 (3h4m41.648738143s) [noise=true , address=104.36.82.43:4839 , piece_id=AASR2GINCPJWAUGKDQHCP34LW7LMP52MJIPR53VGIXO2FXCPXDVQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059589772 (3h4m41.648934759s) [noise=true , address=104.36.82.16:4328 , piece_id=5GU57BU2OWACCQTNUPK2HDZSB56O2GCKDRIUQC5IBNTTSNEHHCQQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059800486 (3h4m41.649145473s) [noise=true , address=104.36.82.9:4010 , piece_id=Y7IK7QTQJEACFYUAONSRB2CHDURLPJTCRE327U2LISUY5EBACBYQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060006750 (3h4m41.649351737s) [noise=true , address=104.36.82.44:4876 , piece_id=774UUJZ3DLY7W5EYRXDZSV6QVQSLL23VHNFGRH7NNKGFVEPMTVCA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060237582 (3h4m41.649582569s) [noise=true , address=104.36.82.11:4131 , piece_id=QVHVYVEKZQCDINOVUUC77BRF2QJIKCCUDCTTJPDVIM2FHPLADLFA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060438997 (3h4m41.649783984s) [noise=true , address=104.36.82.45:4933 , piece_id=MNENPB54S5XZA6OQEPPGIIZL52IB4R6ZMFLL36KTYJWDZQHRCEVA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060690368 (3h4m41.650035355s) [noise=true , address=104.36.82.60:4358 , piece_id=B6MRCY77C5RV4ZSTWKVWUFSAPQG2TVKTTVB2Z6ENTBIOYHWCL3ZA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060940186 (3h4m41.650285163s) [noise=true , address=193.149.164.143:4699 , piece_id=KAEQEEMG3LE5YFYZRJWTOOUACHEPIXKSEK7GTA6MDGFPPCCBSLYA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:43.212302904 (3h4m42.801647891s) [upload=3227]: Next returned nil segment Aug 7 12:44:43.212319755 (3h4m42.801664742s) [upload=3227]: Waiting for error group managing segments... Aug 7 12:44:43.503498048 (3h4m43.092843035s) [noise=true , address=64.49.13.170:4728 , piece_id=ATO77ZWTN4SN5HFWBXPWFGIK66RSULTGBWDQRGL5MDA7X7S2HNGA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:43.540015917 (3h4m43.129360904s) [noise=true , address=193.149.164.143:4699 , piece_id=KAEQEEMG3LE5YFYZRJWTOOUACHEPIXKSEK7GTA6MDGFPPCCBSLYA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:43.970209122 (3h4m43.559554109s) [noise=true , address=104.36.82.16:4328 , piece_id=5GU57BU2OWACCQTNUPK2HDZSB56O2GCKDRIUQC5IBNTTSNEHHCQQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:43.998373508 (3h4m43.587718495s) [noise=true , address=104.36.82.11:4131 , piece_id=QVHVYVEKZQCDINOVUUC77BRF2QJIKCCUDCTTJPDVIM2FHPLADLFA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.041155211 (3h4m43.630500198s) [noise=true , address=45.91.116.5:4322 , piece_id=2HLDBCJ3YWJMJWQ2JP2JMI3YXKM4DB44IEEA56E7UBZTQJKRAQVQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.064338076 (3h4m43.653683053s) [noise=true , address=104.36.82.43:4839 , piece_id=AASR2GINCPJWAUGKDQHCP34LW7LMP52MJIPR53VGIXO2FXCPXDVQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.066369533 (3h4m43.65571452s) [noise=true , address=104.36.82.44:4876 , piece_id=774UUJZ3DLY7W5EYRXDZSV6QVQSLL23VHNFGRH7NNKGFVEPMTVCA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.069041415 (3h4m43.658386402s) [noise=true , address=104.36.82.13:4213 , piece_id=K5V5LSO5WDRTRZVOWVU4Z62BU4DWYODHT7HKSIIF3ZY5TPK43HGA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.088541163 (3h4m43.67788614s) [noise=true , address=104.36.82.9:4010 , piece_id=Y7IK7QTQJEACFYUAONSRB2CHDURLPJTCRE327U2LISUY5EBACBYQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.099794474 (3h4m43.689139451s) [noise=true , address=104.36.82.38:4691 , piece_id=C6EJDEYHTXN2N3C7NMN26463TWBJ5YYGIJ64QRGEHLLXXTJYVFGQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.111843667 (3h4m43.701188654s) [noise=true , address=45.91.116.8:4051 , piece_id=HPS3KTRPFBICO3OLCMRSPZTSALHGWZUKCYVNHMBURE7V4AHYTX7Q, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.119165736 (3h4m43.708510713s) [noise=true , address=104.36.82.47:4534 , piece_id=IXLQ6NCO4Y3R6R3QO3GQ63FYA2PH5FVYWT67OMMYRFEKFQMHBEJA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.119239007 (3h4m43.708583994s) [noise=true , address=104.36.82.46:4493 , piece_id=CGRVETEEYIJETV2IPBDWGRGCZ6RP3MX52ESOOQLX5OWRZCBZTIDQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.135000091 (3h4m43.724345078s) [noise=true , address=104.36.82.14:4256 , piece_id=SJ4NF3P2LAHCLHVGVM46VKJUYZX7UKWE3UCGH7MH5ELU7LL6WRKQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.135059094 (3h4m43.724404101s) [seg_pos={0 0}, upload=3227]: Segment reached optimal threshold of 14 pieces. Aug 7 12:44:44.135262554 (3h4m43.724607541s) [noise=true , address=104.36.82.61:4373 , piece_id=FJD4XPWXSSKXMIG6CQVAXCBKVVZA4NO62RHYFPAZGGREQZMC66OQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135484949 (3h4m43.724829936s) [noise=true , address=104.36.82.58:4295 , piece_id=CKY6LZBUWAHMGAKKEQIH5XV7IPAWWB7JCHYSHL36DU56ZMYYXTKQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oLa34qwPBAx3CTvYYj7GN3oxxWGJ9dAYXfke1eUftZc6xzfqg): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135562708 (3h4m43.724907755s) [noise=true , address=104.36.82.60:4358 , piece_id=B6MRCY77C5RV4ZSTWKVWUFSAPQG2TVKTTVB2Z6ENTBIOYHWCL3ZA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135634896 (3h4m43.724979883s) [noise=true , address=104.36.82.45:4933 , piece_id=MNENPB54S5XZA6OQEPPGIIZL52IB4R6ZMFLL36KTYJWDZQHRCEVA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kj9KJZo29cpWQSprwxjWe82BrKnYYDTuKguPJm9hn8yVG83ou): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135646629 (3h4m43.724991616s) [seg_pos={0 0}, upload=3227]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:44:44.135704088 (3h4m43.725049075s) [upload=3227]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:44:44.135707906 (3h4m43.725052893s) [upload=3227]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:44:44.448005795 (3h4m44.037350782s) [upload=3227]: Done uploading segments... Aug 7 12:44:44.448025623 (3h4m44.037370611s) [upload=3227]: Upload finished. err: <nil> Duration: 5.964153952s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X.........X........................X........X...] duration: 1.82755231s FAIL (2025-08-07 12:45:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 04d0ad23c1dca8101bf835aa4987fd0b5bc13256284ff67d5ed6d9d923e304ab != before 280046d3788d8f2fbaada4dddb492f449037123edff3b4b3c36deababf8b9372 ======LOGS====== 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Aug 7 12:38:41.966251404 (2h58m41.555596391s) [upload=3114]: Starting upload Aug 7 12:38:41.966300308 (2h58m41.555645285s) [upload=3114]: Done starting upload Aug 7 12:38:41.966349633 (2h58m41.55569462s) [upload=3114]: Uploading segments... Aug 7 12:38:41.966378308 (2h58m41.555723285s) [upload=3114]: Got next segment. Inline: true Aug 7 12:38:41.966381914 (2h58m41.555726901s) [upload=3114]: Waiting for error group managing segments... Aug 7 12:38:41.966414186 (2h58m41.555759173s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:41.966418334 (2h58m41.555763321s) [upload=3114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:41.966420809 (2h58m41.555765786s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:42.281004521 (2h58m41.870349518s) [upload=3114]: Done uploading segments... Aug 7 12:38:42.281026093 (2h58m41.87037108s) [upload=3114]: Upload finished. err: <nil> Aug 7 12:39:19.370352705 (2h59m18.959697692s) [upload=3126]: Starting upload Aug 7 12:39:19.370398824 (2h59m18.959743811s) [upload=3126]: Done starting upload Aug 7 12:39:19.370449962 (2h59m18.959794939s) [upload=3126]: Uploading segments... Aug 7 12:39:19.370482203 (2h59m18.95982718s) [upload=3126]: Got next segment. Inline: true Aug 7 12:39:19.370485850 (2h59m18.959830837s) [upload=3126]: Waiting for error group managing segments... Aug 7 12:39:19.370518462 (2h59m18.959863449s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:19.370522750 (2h59m18.959867737s) [upload=3126]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:19.370524854 (2h59m18.959869841s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:19.645497369 (2h59m19.234842356s) [upload=3126]: Done uploading segments... Aug 7 12:39:19.645515023 (2h59m19.23486s) [upload=3126]: Upload finished. err: <nil> Aug 7 12:39:51.464710987 (2h59m51.054055974s) [upload=3136]: Starting upload Aug 7 12:39:51.464768887 (2h59m51.054113874s) [upload=3136]: Done starting upload Aug 7 12:39:51.464813904 (2h59m51.054158891s) [upload=3136]: Uploading segments... Aug 7 12:39:51.464844192 (2h59m51.054189179s) [upload=3136]: Got next segment. Inline: true Aug 7 12:39:51.464847828 (2h59m51.054192815s) [upload=3136]: Waiting for error group managing segments... Aug 7 12:39:51.464884107 (2h59m51.054229095s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:51.464888025 (2h59m51.054233012s) [upload=3136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:51.464890410 (2h59m51.054235397s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:51.743251199 (2h59m51.332596176s) [upload=3136]: Done uploading segments... Aug 7 12:39:51.743267881 (2h59m51.332612868s) [upload=3136]: Upload finished. err: <nil> Aug 7 12:40:08.156888598 (3h0m7.746233585s) [upload=3141]: Starting upload Aug 7 12:40:08.156936880 (3h0m7.746281867s) [upload=3141]: Done starting upload Aug 7 12:40:08.157031731 (3h0m7.746376718s) [upload=3141]: Uploading segments... Aug 7 12:40:08.157136983 (3h0m7.74648197s) [upload=3141]: Got next segment. Inline: true Aug 7 12:40:08.157142563 (3h0m7.74648755s) [upload=3141]: Waiting for error group managing segments... Aug 7 12:40:08.157185015 (3h0m7.746529992s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:40:08.157191126 (3h0m7.746536113s) [upload=3141]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:40:08.157193541 (3h0m7.746538528s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:40:08.434339995 (3h0m8.023684982s) [upload=3141]: Done uploading segments... Aug 7 12:40:08.434360715 (3h0m8.023705702s) [upload=3141]: Upload finished. err: <nil> Aug 7 12:41:14.906198200 (3h1m14.495543187s) [upload=3161]: Starting upload Aug 7 12:41:14.906248987 (3h1m14.495593974s) [upload=3161]: Done starting upload Aug 7 12:41:14.906301908 (3h1m14.495646885s) [upload=3161]: Uploading segments... Aug 7 12:41:14.906339159 (3h1m14.495684146s) [upload=3161]: Got next segment. Inline: true Aug 7 12:41:14.906343557 (3h1m14.495688544s) [upload=3161]: Waiting for error group managing segments... Aug 7 12:41:14.906376871 (3h1m14.495721858s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Duration: 1.827596344s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.745369627s FAIL (2025-08-07 12:45:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Commit Aug 7 12:43:31.850361795 (3h3m31.439706782s) [upload=3207]: Done uploading segments... Aug 7 12:43:31.850381663 (3h3m31.43972665s) [upload=3207]: Upload finished. err: <nil> Aug 7 12:44:41.569452026 (3h4m41.158797013s) [upload=3227]: Starting upload Aug 7 12:44:41.569495419 (3h4m41.158840406s) [upload=3227]: Done starting upload Aug 7 12:44:41.569663952 (3h4m41.159008989s) [upload=3227]: Uploading segments... Aug 7 12:44:41.569767339 (3h4m41.159112326s) [upload=3227]: Got next segment. Inline: false Aug 7 12:44:41.569827344 (3h4m41.159172331s) [upload=3227]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:44:41.569831713 (3h4m41.1591767s) [upload=3227]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:44:42.056678863 (3h4m41.64602385s) [seg_pos={0 0}, upload=3227]: Begin upload segment... Aug 7 12:44:42.056728047 (3h4m41.646073034s) [seg_pos={0 0}, upload=3227]: Done begin upload segment. Aug 7 12:44:42.056748837 (3h4m41.646093824s) [noise=true , address=104.36.82.46:4493 , piece_id=CGRVETEEYIJETV2IPBDWGRGCZ6RP3MX52ESOOQLX5OWRZCBZTIDQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057250927 (3h4m41.646595914s) [noise=true , address=104.36.82.47:4534 , piece_id=IXLQ6NCO4Y3R6R3QO3GQ63FYA2PH5FVYWT67OMMYRFEKFQMHBEJA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057557604 (3h4m41.646902591s) [noise=true , address=104.36.82.14:4256 , piece_id=SJ4NF3P2LAHCLHVGVM46VKJUYZX7UKWE3UCGH7MH5ELU7LL6WRKQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057875833 (3h4m41.64722082s) [noise=true , address=104.36.82.38:4691 , piece_id=C6EJDEYHTXN2N3C7NMN26463TWBJ5YYGIJ64QRGEHLLXXTJYVFGQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057884800 (3h4m41.647229777s) [noise=true , address=45.91.116.8:4051 , piece_id=HPS3KTRPFBICO3OLCMRSPZTSALHGWZUKCYVNHMBURE7V4AHYTX7Q, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058180436 (3h4m41.647525423s) [noise=true , address=104.36.82.13:4213 , piece_id=K5V5LSO5WDRTRZVOWVU4Z62BU4DWYODHT7HKSIIF3ZY5TPK43HGA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058208089 (3h4m41.647553076s) [noise=true , address=64.49.13.170:4728 , piece_id=ATO77ZWTN4SN5HFWBXPWFGIK66RSULTGBWDQRGL5MDA7X7S2HNGA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058469589 (3h4m41.647814566s) [noise=true , address=104.36.82.58:4295 , piece_id=CKY6LZBUWAHMGAKKEQIH5XV7IPAWWB7JCHYSHL36DU56ZMYYXTKQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058810582 (3h4m41.648155569s) [noise=true , address=45.91.116.5:4322 , piece_id=2HLDBCJ3YWJMJWQ2JP2JMI3YXKM4DB44IEEA56E7UBZTQJKRAQVQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059158306 (3h4m41.648503283s) [noise=true , address=104.36.82.61:4373 , piece_id=FJD4XPWXSSKXMIG6CQVAXCBKVVZA4NO62RHYFPAZGGREQZMC66OQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059393156 (3h4m41.648738143s) [noise=true , address=104.36.82.43:4839 , piece_id=AASR2GINCPJWAUGKDQHCP34LW7LMP52MJIPR53VGIXO2FXCPXDVQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059589772 (3h4m41.648934759s) [noise=true , address=104.36.82.16:4328 , piece_id=5GU57BU2OWACCQTNUPK2HDZSB56O2GCKDRIUQC5IBNTTSNEHHCQQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059800486 (3h4m41.649145473s) [noise=true , address=104.36.82.9:4010 , piece_id=Y7IK7QTQJEACFYUAONSRB2CHDURLPJTCRE327U2LISUY5EBACBYQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060006750 (3h4m41.649351737s) [noise=true , address=104.36.82.44:4876 , piece_id=774UUJZ3DLY7W5EYRXDZSV6QVQSLL23VHNFGRH7NNKGFVEPMTVCA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060237582 (3h4m41.649582569s) [noise=true , address=104.36.82.11:4131 , piece_id=QVHVYVEKZQCDINOVUUC77BRF2QJIKCCUDCTTJPDVIM2FHPLADLFA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060438997 (3h4m41.649783984s) [noise=true , address=104.36.82.45:4933 , piece_id=MNENPB54S5XZA6OQEPPGIIZL52IB4R6ZMFLL36KTYJWDZQHRCEVA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060690368 (3h4m41.650035355s) [noise=true , address=104.36.82.60:4358 , piece_id=B6MRCY77C5RV4ZSTWKVWUFSAPQG2TVKTTVB2Z6ENTBIOYHWCL3ZA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060940186 (3h4m41.650285163s) [noise=true , address=193.149.164.143:4699 , piece_id=KAEQEEMG3LE5YFYZRJWTOOUACHEPIXKSEK7GTA6MDGFPPCCBSLYA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:43.212302904 (3h4m42.801647891s) [upload=3227]: Next returned nil segment Aug 7 12:44:43.212319755 (3h4m42.801664742s) [upload=3227]: Waiting for error group managing segments... Aug 7 12:44:43.503498048 (3h4m43.092843035s) [noise=true , address=64.49.13.170:4728 , piece_id=ATO77ZWTN4SN5HFWBXPWFGIK66RSULTGBWDQRGL5MDA7X7S2HNGA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:43.540015917 (3h4m43.129360904s) [noise=true , address=193.149.164.143:4699 , piece_id=KAEQEEMG3LE5YFYZRJWTOOUACHEPIXKSEK7GTA6MDGFPPCCBSLYA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:43.970209122 (3h4m43.559554109s) [noise=true , address=104.36.82.16:4328 , piece_id=5GU57BU2OWACCQTNUPK2HDZSB56O2GCKDRIUQC5IBNTTSNEHHCQQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:43.998373508 (3h4m43.587718495s) [noise=true , address=104.36.82.11:4131 , piece_id=QVHVYVEKZQCDINOVUUC77BRF2QJIKCCUDCTTJPDVIM2FHPLADLFA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.041155211 (3h4m43.630500198s) [noise=true , address=45.91.116.5:4322 , piece_id=2HLDBCJ3YWJMJWQ2JP2JMI3YXKM4DB44IEEA56E7UBZTQJKRAQVQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.064338076 (3h4m43.653683053s) [noise=true , address=104.36.82.43:4839 , piece_id=AASR2GINCPJWAUGKDQHCP34LW7LMP52MJIPR53VGIXO2FXCPXDVQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.066369533 (3h4m43.65571452s) [noise=true , address=104.36.82.44:4876 , piece_id=774UUJZ3DLY7W5EYRXDZSV6QVQSLL23VHNFGRH7NNKGFVEPMTVCA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.069041415 (3h4m43.658386402s) [noise=true , address=104.36.82.13:4213 , piece_id=K5V5LSO5WDRTRZVOWVU4Z62BU4DWYODHT7HKSIIF3ZY5TPK43HGA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.088541163 (3h4m43.67788614s) [noise=true , address=104.36.82.9:4010 , piece_id=Y7IK7QTQJEACFYUAONSRB2CHDURLPJTCRE327U2LISUY5EBACBYQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.099794474 (3h4m43.689139451s) [noise=true , address=104.36.82.38:4691 , piece_id=C6EJDEYHTXN2N3C7NMN26463TWBJ5YYGIJ64QRGEHLLXXTJYVFGQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.111843667 (3h4m43.701188654s) [noise=true , address=45.91.116.8:4051 , piece_id=HPS3KTRPFBICO3OLCMRSPZTSALHGWZUKCYVNHMBURE7V4AHYTX7Q, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.119165736 (3h4m43.708510713s) [noise=true , address=104.36.82.47:4534 , piece_id=IXLQ6NCO4Y3R6R3QO3GQ63FYA2PH5FVYWT67OMMYRFEKFQMHBEJA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.119239007 (3h4m43.708583994s) [noise=true , address=104.36.82.46:4493 , piece_id=CGRVETEEYIJETV2IPBDWGRGCZ6RP3MX52ESOOQLX5OWRZCBZTIDQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.135000091 (3h4m43.724345078s) [noise=true , address=104.36.82.14:4256 , piece_id=SJ4NF3P2LAHCLHVGVM46VKJUYZX7UKWE3UCGH7MH5ELU7LL6WRKQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.135059094 (3h4m43.724404101s) [seg_pos={0 0}, upload=3227]: Segment reached optimal threshold of 14 pieces. Aug 7 12:44:44.135262554 (3h4m43.724607541s) [noise=true , address=104.36.82.61:4373 , piece_id=FJD4XPWXSSKXMIG6CQVAXCBKVVZA4NO62RHYFPAZGGREQZMC66OQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135484949 (3h4m43.724829936s) [noise=true , address=104.36.82.58:4295 , piece_id=CKY6LZBUWAHMGAKKEQIH5XV7IPAWWB7JCHYSHL36DU56ZMYYXTKQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oLa34qwPBAx3CTvYYj7GN3oxxWGJ9dAYXfke1eUftZc6xzfqg): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135562708 (3h4m43.724907755s) [noise=true , address=104.36.82.60:4358 , piece_id=B6MRCY77C5RV4ZSTWKVWUFSAPQG2TVKTTVB2Z6ENTBIOYHWCL3ZA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135634896 (3h4m43.724979883s) [noise=true , address=104.36.82.45:4933 , piece_id=MNENPB54S5XZA6OQEPPGIIZL52IB4R6ZMFLL36KTYJWDZQHRCEVA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kj9KJZo29cpWQSprwxjWe82BrKnYYDTuKguPJm9hn8yVG83ou): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135646629 (3h4m43.724991616s) [seg_pos={0 0}, upload=3227]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:44:44.135704088 (3h4m43.725049075s) [upload=3227]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:44:44.135707906 (3h4m43.725052893s) [upload=3227]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:44:44.448005795 (3h4m44.037350782s) [upload=3227]: Done uploading segments... Aug 7 12:44:44.448025623 (3h4m44.037370611s) [upload=3227]: Upload finished. err: <nil> Duration: 5.745399524s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............X.........X........................X........X..] duration: 2.079021228s FAIL (2025-08-07 12:44:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 04d0ad23c1dca8101bf835aa4987fd0b5bc13256284ff67d5ed6d9d923e304ab != before 280046d3788d8f2fbaada4dddb492f449037123edff3b4b3c36deababf8b9372 ======LOGS====== 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Aug 7 12:38:41.966251404 (2h58m41.555596391s) [upload=3114]: Starting upload Aug 7 12:38:41.966300308 (2h58m41.555645285s) [upload=3114]: Done starting upload Aug 7 12:38:41.966349633 (2h58m41.55569462s) [upload=3114]: Uploading segments... Aug 7 12:38:41.966378308 (2h58m41.555723285s) [upload=3114]: Got next segment. Inline: true Aug 7 12:38:41.966381914 (2h58m41.555726901s) [upload=3114]: Waiting for error group managing segments... Aug 7 12:38:41.966414186 (2h58m41.555759173s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:41.966418334 (2h58m41.555763321s) [upload=3114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:41.966420809 (2h58m41.555765786s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:42.281004521 (2h58m41.870349518s) [upload=3114]: Done uploading segments... Aug 7 12:38:42.281026093 (2h58m41.87037108s) [upload=3114]: Upload finished. err: <nil> Aug 7 12:39:19.370352705 (2h59m18.959697692s) [upload=3126]: Starting upload Aug 7 12:39:19.370398824 (2h59m18.959743811s) [upload=3126]: Done starting upload Aug 7 12:39:19.370449962 (2h59m18.959794939s) [upload=3126]: Uploading segments... Aug 7 12:39:19.370482203 (2h59m18.95982718s) [upload=3126]: Got next segment. Inline: true Aug 7 12:39:19.370485850 (2h59m18.959830837s) [upload=3126]: Waiting for error group managing segments... Aug 7 12:39:19.370518462 (2h59m18.959863449s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:19.370522750 (2h59m18.959867737s) [upload=3126]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:19.370524854 (2h59m18.959869841s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:19.645497369 (2h59m19.234842356s) [upload=3126]: Done uploading segments... Aug 7 12:39:19.645515023 (2h59m19.23486s) [upload=3126]: Upload finished. err: <nil> Aug 7 12:39:51.464710987 (2h59m51.054055974s) [upload=3136]: Starting upload Aug 7 12:39:51.464768887 (2h59m51.054113874s) [upload=3136]: Done starting upload Aug 7 12:39:51.464813904 (2h59m51.054158891s) [upload=3136]: Uploading segments... Aug 7 12:39:51.464844192 (2h59m51.054189179s) [upload=3136]: Got next segment. Inline: true Aug 7 12:39:51.464847828 (2h59m51.054192815s) [upload=3136]: Waiting for error group managing segments... Aug 7 12:39:51.464884107 (2h59m51.054229095s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:51.464888025 (2h59m51.054233012s) [upload=3136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:51.464890410 (2h59m51.054235397s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:51.743251199 (2h59m51.332596176s) [upload=3136]: Done uploading segments... Aug 7 12:39:51.743267881 (2h59m51.332612868s) [upload=3136]: Upload finished. err: <nil> Aug 7 12:40:08.156888598 (3h0m7.746233585s) [upload=3141]: Starting upload Aug 7 12:40:08.156936880 (3h0m7.746281867s) [upload=3141]: Done starting upload Aug 7 12:40:08.157031731 (3h0m7.746376718s) [upload=3141]: Uploading segments... Aug 7 12:40:08.157136983 (3h0m7.74648197s) [upload=3141]: Got next segment. Inline: true Aug 7 12:40:08.157142563 (3h0m7.74648755s) [upload=3141]: Waiting for error group managing segments... Aug 7 12:40:08.157185015 (3h0m7.746529992s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:40:08.157191126 (3h0m7.746536113s) [upload=3141]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:40:08.157193541 (3h0m7.746538528s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:40:08.434339995 (3h0m8.023684982s) [upload=3141]: Done uploading segments... Aug 7 12:40:08.434360715 (3h0m8.023705702s) [upload=3141]: Upload finished. err: <nil> Aug 7 12:41:14.906198200 (3h1m14.495543187s) [upload=3161]: Starting upload Aug 7 12:41:14.906248987 (3h1m14.495593974s) [upload=3161]: Done starting upload Aug 7 12:41:14.906301908 (3h1m14.495646885s) [upload=3161]: Uploading segments... Aug 7 12:41:14.906339159 (3h1m14.495684146s) [upload=3161]: Got next segment. Inline: true Aug 7 12:41:14.906343557 (3h1m14.495688544s) [upload=3161]: Waiting for error group managing segments... Aug 7 12:41:14.906376871 (3h1m14.495721858s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Duration: 2.079047979s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 4.203078461s FAIL (2025-08-07 12:44:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Commit Aug 7 12:43:31.850361795 (3h3m31.439706782s) [upload=3207]: Done uploading segments... Aug 7 12:43:31.850381663 (3h3m31.43972665s) [upload=3207]: Upload finished. err: <nil> Aug 7 12:44:41.569452026 (3h4m41.158797013s) [upload=3227]: Starting upload Aug 7 12:44:41.569495419 (3h4m41.158840406s) [upload=3227]: Done starting upload Aug 7 12:44:41.569663952 (3h4m41.159008989s) [upload=3227]: Uploading segments... Aug 7 12:44:41.569767339 (3h4m41.159112326s) [upload=3227]: Got next segment. Inline: false Aug 7 12:44:41.569827344 (3h4m41.159172331s) [upload=3227]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:44:41.569831713 (3h4m41.1591767s) [upload=3227]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 12:44:42.056678863 (3h4m41.64602385s) [seg_pos={0 0}, upload=3227]: Begin upload segment... Aug 7 12:44:42.056728047 (3h4m41.646073034s) [seg_pos={0 0}, upload=3227]: Done begin upload segment. Aug 7 12:44:42.056748837 (3h4m41.646093824s) [noise=true , address=104.36.82.46:4493 , piece_id=CGRVETEEYIJETV2IPBDWGRGCZ6RP3MX52ESOOQLX5OWRZCBZTIDQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057250927 (3h4m41.646595914s) [noise=true , address=104.36.82.47:4534 , piece_id=IXLQ6NCO4Y3R6R3QO3GQ63FYA2PH5FVYWT67OMMYRFEKFQMHBEJA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057557604 (3h4m41.646902591s) [noise=true , address=104.36.82.14:4256 , piece_id=SJ4NF3P2LAHCLHVGVM46VKJUYZX7UKWE3UCGH7MH5ELU7LL6WRKQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057875833 (3h4m41.64722082s) [noise=true , address=104.36.82.38:4691 , piece_id=C6EJDEYHTXN2N3C7NMN26463TWBJ5YYGIJ64QRGEHLLXXTJYVFGQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.057884800 (3h4m41.647229777s) [noise=true , address=45.91.116.8:4051 , piece_id=HPS3KTRPFBICO3OLCMRSPZTSALHGWZUKCYVNHMBURE7V4AHYTX7Q, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058180436 (3h4m41.647525423s) [noise=true , address=104.36.82.13:4213 , piece_id=K5V5LSO5WDRTRZVOWVU4Z62BU4DWYODHT7HKSIIF3ZY5TPK43HGA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058208089 (3h4m41.647553076s) [noise=true , address=64.49.13.170:4728 , piece_id=ATO77ZWTN4SN5HFWBXPWFGIK66RSULTGBWDQRGL5MDA7X7S2HNGA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058469589 (3h4m41.647814566s) [noise=true , address=104.36.82.58:4295 , piece_id=CKY6LZBUWAHMGAKKEQIH5XV7IPAWWB7JCHYSHL36DU56ZMYYXTKQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.058810582 (3h4m41.648155569s) [noise=true , address=45.91.116.5:4322 , piece_id=2HLDBCJ3YWJMJWQ2JP2JMI3YXKM4DB44IEEA56E7UBZTQJKRAQVQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059158306 (3h4m41.648503283s) [noise=true , address=104.36.82.61:4373 , piece_id=FJD4XPWXSSKXMIG6CQVAXCBKVVZA4NO62RHYFPAZGGREQZMC66OQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059393156 (3h4m41.648738143s) [noise=true , address=104.36.82.43:4839 , piece_id=AASR2GINCPJWAUGKDQHCP34LW7LMP52MJIPR53VGIXO2FXCPXDVQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059589772 (3h4m41.648934759s) [noise=true , address=104.36.82.16:4328 , piece_id=5GU57BU2OWACCQTNUPK2HDZSB56O2GCKDRIUQC5IBNTTSNEHHCQQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.059800486 (3h4m41.649145473s) [noise=true , address=104.36.82.9:4010 , piece_id=Y7IK7QTQJEACFYUAONSRB2CHDURLPJTCRE327U2LISUY5EBACBYQ, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060006750 (3h4m41.649351737s) [noise=true , address=104.36.82.44:4876 , piece_id=774UUJZ3DLY7W5EYRXDZSV6QVQSLL23VHNFGRH7NNKGFVEPMTVCA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060237582 (3h4m41.649582569s) [noise=true , address=104.36.82.11:4131 , piece_id=QVHVYVEKZQCDINOVUUC77BRF2QJIKCCUDCTTJPDVIM2FHPLADLFA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060438997 (3h4m41.649783984s) [noise=true , address=104.36.82.45:4933 , piece_id=MNENPB54S5XZA6OQEPPGIIZL52IB4R6ZMFLL36KTYJWDZQHRCEVA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060690368 (3h4m41.650035355s) [noise=true , address=104.36.82.60:4358 , piece_id=B6MRCY77C5RV4ZSTWKVWUFSAPQG2TVKTTVB2Z6ENTBIOYHWCL3ZA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:42.060940186 (3h4m41.650285163s) [noise=true , address=193.149.164.143:4699 , piece_id=KAEQEEMG3LE5YFYZRJWTOOUACHEPIXKSEK7GTA6MDGFPPCCBSLYA, seg_pos={0 0}, upload=3227]: Uploading piece... Aug 7 12:44:43.212302904 (3h4m42.801647891s) [upload=3227]: Next returned nil segment Aug 7 12:44:43.212319755 (3h4m42.801664742s) [upload=3227]: Waiting for error group managing segments... Aug 7 12:44:43.503498048 (3h4m43.092843035s) [noise=true , address=64.49.13.170:4728 , piece_id=ATO77ZWTN4SN5HFWBXPWFGIK66RSULTGBWDQRGL5MDA7X7S2HNGA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:43.540015917 (3h4m43.129360904s) [noise=true , address=193.149.164.143:4699 , piece_id=KAEQEEMG3LE5YFYZRJWTOOUACHEPIXKSEK7GTA6MDGFPPCCBSLYA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:43.970209122 (3h4m43.559554109s) [noise=true , address=104.36.82.16:4328 , piece_id=5GU57BU2OWACCQTNUPK2HDZSB56O2GCKDRIUQC5IBNTTSNEHHCQQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:43.998373508 (3h4m43.587718495s) [noise=true , address=104.36.82.11:4131 , piece_id=QVHVYVEKZQCDINOVUUC77BRF2QJIKCCUDCTTJPDVIM2FHPLADLFA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.041155211 (3h4m43.630500198s) [noise=true , address=45.91.116.5:4322 , piece_id=2HLDBCJ3YWJMJWQ2JP2JMI3YXKM4DB44IEEA56E7UBZTQJKRAQVQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.064338076 (3h4m43.653683053s) [noise=true , address=104.36.82.43:4839 , piece_id=AASR2GINCPJWAUGKDQHCP34LW7LMP52MJIPR53VGIXO2FXCPXDVQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.066369533 (3h4m43.65571452s) [noise=true , address=104.36.82.44:4876 , piece_id=774UUJZ3DLY7W5EYRXDZSV6QVQSLL23VHNFGRH7NNKGFVEPMTVCA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.069041415 (3h4m43.658386402s) [noise=true , address=104.36.82.13:4213 , piece_id=K5V5LSO5WDRTRZVOWVU4Z62BU4DWYODHT7HKSIIF3ZY5TPK43HGA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.088541163 (3h4m43.67788614s) [noise=true , address=104.36.82.9:4010 , piece_id=Y7IK7QTQJEACFYUAONSRB2CHDURLPJTCRE327U2LISUY5EBACBYQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.099794474 (3h4m43.689139451s) [noise=true , address=104.36.82.38:4691 , piece_id=C6EJDEYHTXN2N3C7NMN26463TWBJ5YYGIJ64QRGEHLLXXTJYVFGQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.111843667 (3h4m43.701188654s) [noise=true , address=45.91.116.8:4051 , piece_id=HPS3KTRPFBICO3OLCMRSPZTSALHGWZUKCYVNHMBURE7V4AHYTX7Q, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.119165736 (3h4m43.708510713s) [noise=true , address=104.36.82.47:4534 , piece_id=IXLQ6NCO4Y3R6R3QO3GQ63FYA2PH5FVYWT67OMMYRFEKFQMHBEJA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.119239007 (3h4m43.708583994s) [noise=true , address=104.36.82.46:4493 , piece_id=CGRVETEEYIJETV2IPBDWGRGCZ6RP3MX52ESOOQLX5OWRZCBZTIDQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.135000091 (3h4m43.724345078s) [noise=true , address=104.36.82.14:4256 , piece_id=SJ4NF3P2LAHCLHVGVM46VKJUYZX7UKWE3UCGH7MH5ELU7LL6WRKQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: <nil> Aug 7 12:44:44.135059094 (3h4m43.724404101s) [seg_pos={0 0}, upload=3227]: Segment reached optimal threshold of 14 pieces. Aug 7 12:44:44.135262554 (3h4m43.724607541s) [noise=true , address=104.36.82.61:4373 , piece_id=FJD4XPWXSSKXMIG6CQVAXCBKVVZA4NO62RHYFPAZGGREQZMC66OQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AQGSkJuNJDxoeqhChUenWxHwF5yK41UESCF63FQz3XvabXXfz): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135484949 (3h4m43.724829936s) [noise=true , address=104.36.82.58:4295 , piece_id=CKY6LZBUWAHMGAKKEQIH5XV7IPAWWB7JCHYSHL36DU56ZMYYXTKQ, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1oLa34qwPBAx3CTvYYj7GN3oxxWGJ9dAYXfke1eUftZc6xzfqg): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135562708 (3h4m43.724907755s) [noise=true , address=104.36.82.60:4358 , piece_id=B6MRCY77C5RV4ZSTWKVWUFSAPQG2TVKTTVB2Z6ENTBIOYHWCL3ZA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135634896 (3h4m43.724979883s) [noise=true , address=104.36.82.45:4933 , piece_id=MNENPB54S5XZA6OQEPPGIIZL52IB4R6ZMFLL36KTYJWDZQHRCEVA, seg_pos={0 0}, upload=3227]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kj9KJZo29cpWQSprwxjWe82BrKnYYDTuKguPJm9hn8yVG83ou): protocol: expected piece hash; context canceled; EOF Aug 7 12:44:44.135646629 (3h4m43.724991616s) [seg_pos={0 0}, upload=3227]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 12:44:44.135704088 (3h4m43.725049075s) [upload=3227]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 12:44:44.135707906 (3h4m43.725052893s) [upload=3227]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:44:44.448005795 (3h4m44.037350782s) [upload=3227]: Done uploading segments... Aug 7 12:44:44.448025623 (3h4m44.037370611s) [upload=3227]: Upload finished. err: <nil> Duration: 4.203099591s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X.........X........................X........X.] duration: 1.869115422s FAIL (2025-08-07 12:44:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 04d0ad23c1dca8101bf835aa4987fd0b5bc13256284ff67d5ed6d9d923e304ab != before 280046d3788d8f2fbaada4dddb492f449037123edff3b4b3c36deababf8b9372 ======LOGS====== 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Aug 7 12:38:41.966251404 (2h58m41.555596391s) [upload=3114]: Starting upload Aug 7 12:38:41.966300308 (2h58m41.555645285s) [upload=3114]: Done starting upload Aug 7 12:38:41.966349633 (2h58m41.55569462s) [upload=3114]: Uploading segments... Aug 7 12:38:41.966378308 (2h58m41.555723285s) [upload=3114]: Got next segment. Inline: true Aug 7 12:38:41.966381914 (2h58m41.555726901s) [upload=3114]: Waiting for error group managing segments... Aug 7 12:38:41.966414186 (2h58m41.555759173s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:41.966418334 (2h58m41.555763321s) [upload=3114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:41.966420809 (2h58m41.555765786s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:42.281004521 (2h58m41.870349518s) [upload=3114]: Done uploading segments... Aug 7 12:38:42.281026093 (2h58m41.87037108s) [upload=3114]: Upload finished. err: <nil> Aug 7 12:39:19.370352705 (2h59m18.959697692s) [upload=3126]: Starting upload Aug 7 12:39:19.370398824 (2h59m18.959743811s) [upload=3126]: Done starting upload Aug 7 12:39:19.370449962 (2h59m18.959794939s) [upload=3126]: Uploading segments... Aug 7 12:39:19.370482203 (2h59m18.95982718s) [upload=3126]: Got next segment. Inline: true Aug 7 12:39:19.370485850 (2h59m18.959830837s) [upload=3126]: Waiting for error group managing segments... Aug 7 12:39:19.370518462 (2h59m18.959863449s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:19.370522750 (2h59m18.959867737s) [upload=3126]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:19.370524854 (2h59m18.959869841s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:19.645497369 (2h59m19.234842356s) [upload=3126]: Done uploading segments... Aug 7 12:39:19.645515023 (2h59m19.23486s) [upload=3126]: Upload finished. err: <nil> Aug 7 12:39:51.464710987 (2h59m51.054055974s) [upload=3136]: Starting upload Aug 7 12:39:51.464768887 (2h59m51.054113874s) [upload=3136]: Done starting upload Aug 7 12:39:51.464813904 (2h59m51.054158891s) [upload=3136]: Uploading segments... Aug 7 12:39:51.464844192 (2h59m51.054189179s) [upload=3136]: Got next segment. Inline: true Aug 7 12:39:51.464847828 (2h59m51.054192815s) [upload=3136]: Waiting for error group managing segments... Aug 7 12:39:51.464884107 (2h59m51.054229095s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:51.464888025 (2h59m51.054233012s) [upload=3136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:51.464890410 (2h59m51.054235397s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:51.743251199 (2h59m51.332596176s) [upload=3136]: Done uploading segments... Aug 7 12:39:51.743267881 (2h59m51.332612868s) [upload=3136]: Upload finished. err: <nil> Aug 7 12:40:08.156888598 (3h0m7.746233585s) [upload=3141]: Starting upload Aug 7 12:40:08.156936880 (3h0m7.746281867s) [upload=3141]: Done starting upload Aug 7 12:40:08.157031731 (3h0m7.746376718s) [upload=3141]: Uploading segments... Aug 7 12:40:08.157136983 (3h0m7.74648197s) [upload=3141]: Got next segment. Inline: true Aug 7 12:40:08.157142563 (3h0m7.74648755s) [upload=3141]: Waiting for error group managing segments... Aug 7 12:40:08.157185015 (3h0m7.746529992s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:40:08.157191126 (3h0m7.746536113s) [upload=3141]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:40:08.157193541 (3h0m7.746538528s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:40:08.434339995 (3h0m8.023684982s) [upload=3141]: Done uploading segments... Aug 7 12:40:08.434360715 (3h0m8.023705702s) [upload=3141]: Upload finished. err: <nil> Aug 7 12:41:14.906198200 (3h1m14.495543187s) [upload=3161]: Starting upload Aug 7 12:41:14.906248987 (3h1m14.495593974s) [upload=3161]: Done starting upload Aug 7 12:41:14.906301908 (3h1m14.495646885s) [upload=3161]: Uploading segments... Aug 7 12:41:14.906339159 (3h1m14.495684146s) [upload=3161]: Got next segment. Inline: true Aug 7 12:41:14.906343557 (3h1m14.495688544s) [upload=3161]: Waiting for error group managing segments... Aug 7 12:41:14.906376871 (3h1m14.495721858s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Duration: 1.869139107s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............X.........X........................X........X] duration: 1.612317106s FAIL (2025-08-07 12:43:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 04d0ad23c1dca8101bf835aa4987fd0b5bc13256284ff67d5ed6d9d923e304ab != before 280046d3788d8f2fbaada4dddb492f449037123edff3b4b3c36deababf8b9372 ======LOGS====== 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Aug 7 12:38:41.966251404 (2h58m41.555596391s) [upload=3114]: Starting upload Aug 7 12:38:41.966300308 (2h58m41.555645285s) [upload=3114]: Done starting upload Aug 7 12:38:41.966349633 (2h58m41.55569462s) [upload=3114]: Uploading segments... Aug 7 12:38:41.966378308 (2h58m41.555723285s) [upload=3114]: Got next segment. Inline: true Aug 7 12:38:41.966381914 (2h58m41.555726901s) [upload=3114]: Waiting for error group managing segments... Aug 7 12:38:41.966414186 (2h58m41.555759173s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:41.966418334 (2h58m41.555763321s) [upload=3114]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:41.966420809 (2h58m41.555765786s) [upload=3114]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:42.281004521 (2h58m41.870349518s) [upload=3114]: Done uploading segments... Aug 7 12:38:42.281026093 (2h58m41.87037108s) [upload=3114]: Upload finished. err: <nil> Aug 7 12:39:19.370352705 (2h59m18.959697692s) [upload=3126]: Starting upload Aug 7 12:39:19.370398824 (2h59m18.959743811s) [upload=3126]: Done starting upload Aug 7 12:39:19.370449962 (2h59m18.959794939s) [upload=3126]: Uploading segments... Aug 7 12:39:19.370482203 (2h59m18.95982718s) [upload=3126]: Got next segment. Inline: true Aug 7 12:39:19.370485850 (2h59m18.959830837s) [upload=3126]: Waiting for error group managing segments... Aug 7 12:39:19.370518462 (2h59m18.959863449s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:19.370522750 (2h59m18.959867737s) [upload=3126]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:19.370524854 (2h59m18.959869841s) [upload=3126]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:19.645497369 (2h59m19.234842356s) [upload=3126]: Done uploading segments... Aug 7 12:39:19.645515023 (2h59m19.23486s) [upload=3126]: Upload finished. err: <nil> Aug 7 12:39:51.464710987 (2h59m51.054055974s) [upload=3136]: Starting upload Aug 7 12:39:51.464768887 (2h59m51.054113874s) [upload=3136]: Done starting upload Aug 7 12:39:51.464813904 (2h59m51.054158891s) [upload=3136]: Uploading segments... Aug 7 12:39:51.464844192 (2h59m51.054189179s) [upload=3136]: Got next segment. Inline: true Aug 7 12:39:51.464847828 (2h59m51.054192815s) [upload=3136]: Waiting for error group managing segments... Aug 7 12:39:51.464884107 (2h59m51.054229095s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:39:51.464888025 (2h59m51.054233012s) [upload=3136]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:39:51.464890410 (2h59m51.054235397s) [upload=3136]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:39:51.743251199 (2h59m51.332596176s) [upload=3136]: Done uploading segments... Aug 7 12:39:51.743267881 (2h59m51.332612868s) [upload=3136]: Upload finished. err: <nil> Aug 7 12:40:08.156888598 (3h0m7.746233585s) [upload=3141]: Starting upload Aug 7 12:40:08.156936880 (3h0m7.746281867s) [upload=3141]: Done starting upload Aug 7 12:40:08.157031731 (3h0m7.746376718s) [upload=3141]: Uploading segments... Aug 7 12:40:08.157136983 (3h0m7.74648197s) [upload=3141]: Got next segment. Inline: true Aug 7 12:40:08.157142563 (3h0m7.74648755s) [upload=3141]: Waiting for error group managing segments... Aug 7 12:40:08.157185015 (3h0m7.746529992s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:40:08.157191126 (3h0m7.746536113s) [upload=3141]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:40:08.157193541 (3h0m7.746538528s) [upload=3141]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:40:08.434339995 (3h0m8.023684982s) [upload=3141]: Done uploading segments... Aug 7 12:40:08.434360715 (3h0m8.023705702s) [upload=3141]: Upload finished. err: <nil> Aug 7 12:41:14.906198200 (3h1m14.495543187s) [upload=3161]: Starting upload Aug 7 12:41:14.906248987 (3h1m14.495593974s) [upload=3161]: Done starting upload Aug 7 12:41:14.906301908 (3h1m14.495646885s) [upload=3161]: Uploading segments... Aug 7 12:41:14.906339159 (3h1m14.495684146s) [upload=3161]: Got next segment. Inline: true Aug 7 12:41:14.906343557 (3h1m14.495688544s) [upload=3161]: Waiting for error group managing segments... Aug 7 12:41:14.906376871 (3h1m14.495721858s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:41:14.906380819 (3h1m14.495725806s) [upload=3161]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:41:14.906383234 (3h1m14.495728221s) [upload=3161]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:41:15.218482583 (3h1m14.80782757s) [upload=3161]: Done uploading segments... Aug 7 12:41:15.218500437 (3h1m14.807845425s) [upload=3161]: Upload finished. err: <nil> Aug 7 12:42:02.720883851 (3h2m2.310228839s) [upload=3176]: Starting upload Aug 7 12:42:02.720947825 (3h2m2.310292812s) [upload=3176]: Done starting upload Aug 7 12:42:02.721010504 (3h2m2.310355491s) [upload=3176]: Uploading segments... Aug 7 12:42:02.721054929 (3h2m2.310399926s) [upload=3176]: Got next segment. Inline: true Aug 7 12:42:02.721060199 (3h2m2.310405186s) [upload=3176]: Waiting for error group managing segments... Aug 7 12:42:02.721103281 (3h2m2.310448268s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:02.721108651 (3h2m2.310453638s) [upload=3176]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:02.721111717 (3h2m2.310456704s) [upload=3176]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:03.016392299 (3h2m2.605737296s) [upload=3176]: Done uploading segments... Aug 7 12:42:03.016410884 (3h2m2.605755871s) [upload=3176]: Upload finished. err: <nil> Aug 7 12:42:18.718026523 (3h2m18.307371511s) [upload=3182]: Starting upload Aug 7 12:42:18.718081429 (3h2m18.307426416s) [upload=3182]: Done starting upload Aug 7 12:42:18.718132156 (3h2m18.307477133s) [upload=3182]: Uploading segments... Aug 7 12:42:18.718161772 (3h2m18.307506759s) [upload=3182]: Got next segment. Inline: true Aug 7 12:42:18.718165249 (3h2m18.307510236s) [upload=3182]: Waiting for error group managing segments... Aug 7 12:42:18.718198412 (3h2m18.307543399s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:42:18.718202430 (3h2m18.307547407s) [upload=3182]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:42:18.718204615 (3h2m18.307549602s) [upload=3182]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:42:19.004508840 (3h2m18.593853827s) [upload=3182]: Done uploading segments... Aug 7 12:42:19.004530582 (3h2m18.593875569s) [upload=3182]: Upload finished. err: <nil> Aug 7 12:43:05.783960743 (3h3m5.37330573s) [upload=3199]: Starting upload Aug 7 12:43:05.784006341 (3h3m5.373351318s) [upload=3199]: Done starting upload Aug 7 12:43:05.784052939 (3h3m5.373397926s) [upload=3199]: Uploading segments... Aug 7 12:43:05.784085903 (3h3m5.37343089s) [upload=3199]: Got next segment. Inline: true Aug 7 12:43:05.784089590 (3h3m5.373434567s) [upload=3199]: Waiting for error group managing segments... Aug 7 12:43:05.784120289 (3h3m5.373465276s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:05.784124156 (3h3m5.373469143s) [upload=3199]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:05.784126340 (3h3m5.373471317s) [upload=3199]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:06.095155732 (3h3m5.684500719s) [upload=3199]: Done uploading segments... Aug 7 12:43:06.095174188 (3h3m5.684519175s) [upload=3199]: Upload finished. err: <nil> Aug 7 12:43:42.932790093 (3h3m42.52213507s) [upload=3209]: Starting upload Aug 7 12:43:42.932831391 (3h3m42.522176378s) [upload=3209]: Done starting upload Aug 7 12:43:42.932876698 (3h3m42.522221685s) [upload=3209]: Uploading segments... Aug 7 12:43:42.932916364 (3h3m42.522261351s) [upload=3209]: Got next segment. Inline: true Aug 7 12:43:42.932920101 (3h3m42.522265078s) [upload=3209]: Waiting for error group managing segments... Aug 7 12:43:42.932952863 (3h3m42.52229785s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:43:42.932956601 (3h3m42.522301578s) [upload=3209]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:43:42.932958976 (3h3m42.522303963s) [upload=3209]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:43:43.213683387 (3h3m42.803028374s) [upload=3209]: Done uploading segments... Aug 7 12:43:43.213701723 (3h3m42.80304674s) [upload=3209]: Upload finished. err: <nil> Duration: 1.612340952s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X.........X........................X........] duration: 1.95519803s FAIL (2025-08-07 12:43:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== equestItem_SegmentMakeInline Aug 7 12:30:27.647630092 (2h50m27.236975079s) [upload=2977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:28.008882523 (2h50m27.5982275s) [upload=2977]: Done uploading segments... Aug 7 12:30:28.008902401 (2h50m27.598247388s) [upload=2977]: Upload finished. err: <nil> Aug 7 12:30:55.159551036 (2h50m54.748896023s) [upload=2983]: Starting upload Aug 7 12:30:55.159591593 (2h50m54.74893658s) [upload=2983]: Done starting upload Aug 7 12:30:55.159661457 (2h50m54.749006444s) [upload=2983]: Uploading segments... Aug 7 12:30:55.159694179 (2h50m54.749039166s) [upload=2983]: Got next segment. Inline: true Aug 7 12:30:55.159697997 (2h50m54.749042984s) [upload=2983]: Waiting for error group managing segments... Aug 7 12:30:55.159739876 (2h50m54.749084893s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:30:55.159748543 (2h50m54.749093571s) [upload=2983]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:30:55.159752260 (2h50m54.749097248s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:55.647163377 (2h50m55.236508364s) [upload=2983]: Done uploading segments... Aug 7 12:30:55.647181432 (2h50m55.236526419s) [upload=2983]: Upload finished. err: <nil> Aug 7 12:31:14.499749821 (2h51m14.089094808s) [upload=2989]: Starting upload Aug 7 12:31:14.499829994 (2h51m14.089174971s) [upload=2989]: Done starting upload Aug 7 12:31:14.499900079 (2h51m14.089245066s) [upload=2989]: Uploading segments... Aug 7 12:31:14.499988067 (2h51m14.089333084s) [upload=2989]: Got next segment. Inline: true Aug 7 12:31:14.499994629 (2h51m14.089339616s) [upload=2989]: Waiting for error group managing segments... Aug 7 12:31:14.500044325 (2h51m14.089389312s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:14.500050466 (2h51m14.089395503s) [upload=2989]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:14.500054143 (2h51m14.08939913s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:14.828960068 (2h51m14.418305065s) [upload=2989]: Done uploading segments... Aug 7 12:31:14.828985195 (2h51m14.418330202s) [upload=2989]: Upload finished. err: <nil> Aug 7 12:31:51.421138752 (2h51m51.010483749s) [upload=2999]: Starting upload Aug 7 12:31:51.421215367 (2h51m51.010560354s) [upload=2999]: Done starting upload Aug 7 12:31:51.421278529 (2h51m51.010623536s) [upload=2999]: Uploading segments... Aug 7 12:31:51.421324687 (2h51m51.010669704s) [upload=2999]: Got next segment. Inline: true Aug 7 12:31:51.421329817 (2h51m51.010674804s) [upload=2999]: Waiting for error group managing segments... Aug 7 12:31:51.421373751 (2h51m51.010718748s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:51.421378500 (2h51m51.010723497s) [upload=2999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:51.421382247 (2h51m51.010727254s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:51.741023086 (2h51m51.330368073s) [upload=2999]: Done uploading segments... Aug 7 12:31:51.741042363 (2h51m51.33038734s) [upload=2999]: Upload finished. err: <nil> Aug 7 12:33:06.378431966 (2h53m5.967776943s) [upload=3023]: Starting upload Aug 7 12:33:06.378479197 (2h53m5.967824174s) [upload=3023]: Done starting upload Aug 7 12:33:06.378544331 (2h53m5.967889318s) [upload=3023]: Uploading segments... Aug 7 12:33:06.378635907 (2h53m5.967980884s) [upload=3023]: Got next segment. Inline: true Aug 7 12:33:06.378640135 (2h53m5.967985112s) [upload=3023]: Waiting for error group managing segments... Aug 7 12:33:06.378683327 (2h53m5.968028314s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:06.378688106 (2h53m5.968033093s) [upload=3023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:06.378690431 (2h53m5.968035418s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:06.654130610 (2h53m6.243475597s) [upload=3023]: Done uploading segments... Aug 7 12:33:06.654148996 (2h53m6.243493973s) [upload=3023]: Upload finished. err: <nil> Aug 7 12:33:35.215249854 (2h53m34.804594841s) [upload=3031]: Starting upload Aug 7 12:33:35.215299758 (2h53m34.804644745s) [upload=3031]: Done starting upload Aug 7 12:33:35.215375503 (2h53m34.80472049s) [upload=3031]: Uploading segments... Aug 7 12:33:35.215408707 (2h53m34.804753694s) [upload=3031]: Got next segment. Inline: true Aug 7 12:33:35.215412754 (2h53m34.804757741s) [upload=3031]: Waiting for error group managing segments... Aug 7 12:33:35.215450507 (2h53m34.804795494s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:35.215454535 (2h53m34.804799522s) [upload=3031]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:35.215457069 (2h53m34.804802057s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:35.540448634 (2h53m35.129793621s) [upload=3031]: Done uploading segments... Aug 7 12:33:35.540468722 (2h53m35.129813709s) [upload=3031]: Upload finished. err: <nil> Aug 7 12:34:40.807496878 (2h54m40.396841865s) [upload=3048]: Starting upload Aug 7 12:34:40.807549308 (2h54m40.396894285s) [upload=3048]: Done starting upload Aug 7 12:34:40.807600165 (2h54m40.396945142s) [upload=3048]: Uploading segments... Aug 7 12:34:40.807631215 (2h54m40.396976202s) [upload=3048]: Got next segment. Inline: true Aug 7 12:34:40.807635593 (2h54m40.39698058s) [upload=3048]: Waiting for error group managing segments... Aug 7 12:34:40.807683445 (2h54m40.397028422s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:34:40.807687412 (2h54m40.397032399s) [upload=3048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:34:40.807689797 (2h54m40.397034784s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:34:41.098874490 (2h54m40.688219467s) [upload=3048]: Done uploading segments... Aug 7 12:34:41.098891382 (2h54m40.688236359s) [upload=3048]: Upload finished. err: <nil> Aug 7 12:35:41.631914876 (2h55m41.221259863s) [upload=3067]: Starting upload Aug 7 12:35:41.631989118 (2h55m41.221334115s) [upload=3067]: Done starting upload Aug 7 12:35:41.632049634 (2h55m41.221394621s) [upload=3067]: Uploading segments... Aug 7 12:35:41.632083659 (2h55m41.221428646s) [upload=3067]: Got next segment. Inline: true Aug 7 12:35:41.632088899 (2h55m41.221433886s) [upload=3067]: Waiting for error group managing segments... Aug 7 12:35:41.632123766 (2h55m41.221468743s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:35:41.632127503 (2h55m41.22147249s) [upload=3067]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:35:41.632129787 (2h55m41.221474774s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:35:42.086896186 (2h55m41.676241253s) [upload=3067]: Done uploading segments... Aug 7 12:35:42.086920282 (2h55m41.676265309s) [upload=3067]: Upload finished. err: <nil> Aug 7 12:36:20.993851564 (2h56m20.583196551s) [upload=3079]: Starting upload Aug 7 12:36:20.993913152 (2h56m20.583258139s) [upload=3079]: Done starting upload Aug 7 12:36:20.994018894 (2h56m20.583363882s) [upload=3079]: Uploading segments... Aug 7 12:36:20.994051757 (2h56m20.583396744s) [upload=3079]: Got next segment. Inline: true Aug 7 12:36:20.994066426 (2h56m20.583411413s) [upload=3079]: Waiting for error group managing segments... Aug 7 12:36:20.994102264 (2h56m20.583447241s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:36:20.994106041 (2h56m20.583451028s) [upload=3079]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:36:20.994108245 (2h56m20.583453222s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:36:21.296488949 (2h56m20.885833936s) [upload=3079]: Done uploading segments... Aug 7 12:36:21.296509168 (2h56m20.885854155s) [upload=3079]: Upload finished. err: <nil> Aug 7 12:37:22.483132350 (2h57m22.072477338s) [upload=3092]: Starting upload Aug 7 12:37:22.483185793 (2h57m22.07253077s) [upload=3092]: Done starting upload Aug 7 12:37:22.483245758 (2h57m22.072590745s) [upload=3092]: Uploading segments... Aug 7 12:37:22.483277098 (2h57m22.072622085s) [upload=3092]: Got next segment. Inline: true Aug 7 12:37:22.483281196 (2h57m22.072626183s) [upload=3092]: Waiting for error group managing segments... Aug 7 12:37:22.483316333 (2h57m22.07266132s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Duration:* 1.955214301s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X.........X........................X.......] duration: 1.84149141s FAIL (2025-08-07 12:42:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== equestItem_SegmentMakeInline Aug 7 12:30:27.647630092 (2h50m27.236975079s) [upload=2977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:28.008882523 (2h50m27.5982275s) [upload=2977]: Done uploading segments... Aug 7 12:30:28.008902401 (2h50m27.598247388s) [upload=2977]: Upload finished. err: <nil> Aug 7 12:30:55.159551036 (2h50m54.748896023s) [upload=2983]: Starting upload Aug 7 12:30:55.159591593 (2h50m54.74893658s) [upload=2983]: Done starting upload Aug 7 12:30:55.159661457 (2h50m54.749006444s) [upload=2983]: Uploading segments... Aug 7 12:30:55.159694179 (2h50m54.749039166s) [upload=2983]: Got next segment. Inline: true Aug 7 12:30:55.159697997 (2h50m54.749042984s) [upload=2983]: Waiting for error group managing segments... Aug 7 12:30:55.159739876 (2h50m54.749084893s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:30:55.159748543 (2h50m54.749093571s) [upload=2983]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:30:55.159752260 (2h50m54.749097248s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:55.647163377 (2h50m55.236508364s) [upload=2983]: Done uploading segments... Aug 7 12:30:55.647181432 (2h50m55.236526419s) [upload=2983]: Upload finished. err: <nil> Aug 7 12:31:14.499749821 (2h51m14.089094808s) [upload=2989]: Starting upload Aug 7 12:31:14.499829994 (2h51m14.089174971s) [upload=2989]: Done starting upload Aug 7 12:31:14.499900079 (2h51m14.089245066s) [upload=2989]: Uploading segments... Aug 7 12:31:14.499988067 (2h51m14.089333084s) [upload=2989]: Got next segment. Inline: true Aug 7 12:31:14.499994629 (2h51m14.089339616s) [upload=2989]: Waiting for error group managing segments... Aug 7 12:31:14.500044325 (2h51m14.089389312s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:14.500050466 (2h51m14.089395503s) [upload=2989]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:14.500054143 (2h51m14.08939913s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:14.828960068 (2h51m14.418305065s) [upload=2989]: Done uploading segments... Aug 7 12:31:14.828985195 (2h51m14.418330202s) [upload=2989]: Upload finished. err: <nil> Aug 7 12:31:51.421138752 (2h51m51.010483749s) [upload=2999]: Starting upload Aug 7 12:31:51.421215367 (2h51m51.010560354s) [upload=2999]: Done starting upload Aug 7 12:31:51.421278529 (2h51m51.010623536s) [upload=2999]: Uploading segments... Aug 7 12:31:51.421324687 (2h51m51.010669704s) [upload=2999]: Got next segment. Inline: true Aug 7 12:31:51.421329817 (2h51m51.010674804s) [upload=2999]: Waiting for error group managing segments... Aug 7 12:31:51.421373751 (2h51m51.010718748s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:51.421378500 (2h51m51.010723497s) [upload=2999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:51.421382247 (2h51m51.010727254s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:51.741023086 (2h51m51.330368073s) [upload=2999]: Done uploading segments... Aug 7 12:31:51.741042363 (2h51m51.33038734s) [upload=2999]: Upload finished. err: <nil> Aug 7 12:33:06.378431966 (2h53m5.967776943s) [upload=3023]: Starting upload Aug 7 12:33:06.378479197 (2h53m5.967824174s) [upload=3023]: Done starting upload Aug 7 12:33:06.378544331 (2h53m5.967889318s) [upload=3023]: Uploading segments... Aug 7 12:33:06.378635907 (2h53m5.967980884s) [upload=3023]: Got next segment. Inline: true Aug 7 12:33:06.378640135 (2h53m5.967985112s) [upload=3023]: Waiting for error group managing segments... Aug 7 12:33:06.378683327 (2h53m5.968028314s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:06.378688106 (2h53m5.968033093s) [upload=3023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:06.378690431 (2h53m5.968035418s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:06.654130610 (2h53m6.243475597s) [upload=3023]: Done uploading segments... Aug 7 12:33:06.654148996 (2h53m6.243493973s) [upload=3023]: Upload finished. err: <nil> Aug 7 12:33:35.215249854 (2h53m34.804594841s) [upload=3031]: Starting upload Aug 7 12:33:35.215299758 (2h53m34.804644745s) [upload=3031]: Done starting upload Aug 7 12:33:35.215375503 (2h53m34.80472049s) [upload=3031]: Uploading segments... Aug 7 12:33:35.215408707 (2h53m34.804753694s) [upload=3031]: Got next segment. Inline: true Aug 7 12:33:35.215412754 (2h53m34.804757741s) [upload=3031]: Waiting for error group managing segments... Aug 7 12:33:35.215450507 (2h53m34.804795494s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:35.215454535 (2h53m34.804799522s) [upload=3031]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:35.215457069 (2h53m34.804802057s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:35.540448634 (2h53m35.129793621s) [upload=3031]: Done uploading segments... Aug 7 12:33:35.540468722 (2h53m35.129813709s) [upload=3031]: Upload finished. err: <nil> Aug 7 12:34:40.807496878 (2h54m40.396841865s) [upload=3048]: Starting upload Aug 7 12:34:40.807549308 (2h54m40.396894285s) [upload=3048]: Done starting upload Aug 7 12:34:40.807600165 (2h54m40.396945142s) [upload=3048]: Uploading segments... Aug 7 12:34:40.807631215 (2h54m40.396976202s) [upload=3048]: Got next segment. Inline: true Aug 7 12:34:40.807635593 (2h54m40.39698058s) [upload=3048]: Waiting for error group managing segments... Aug 7 12:34:40.807683445 (2h54m40.397028422s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:34:40.807687412 (2h54m40.397032399s) [upload=3048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:34:40.807689797 (2h54m40.397034784s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:34:41.098874490 (2h54m40.688219467s) [upload=3048]: Done uploading segments... Aug 7 12:34:41.098891382 (2h54m40.688236359s) [upload=3048]: Upload finished. err: <nil> Aug 7 12:35:41.631914876 (2h55m41.221259863s) [upload=3067]: Starting upload Aug 7 12:35:41.631989118 (2h55m41.221334115s) [upload=3067]: Done starting upload Aug 7 12:35:41.632049634 (2h55m41.221394621s) [upload=3067]: Uploading segments... Aug 7 12:35:41.632083659 (2h55m41.221428646s) [upload=3067]: Got next segment. Inline: true Aug 7 12:35:41.632088899 (2h55m41.221433886s) [upload=3067]: Waiting for error group managing segments... Aug 7 12:35:41.632123766 (2h55m41.221468743s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:35:41.632127503 (2h55m41.22147249s) [upload=3067]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:35:41.632129787 (2h55m41.221474774s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:35:42.086896186 (2h55m41.676241253s) [upload=3067]: Done uploading segments... Aug 7 12:35:42.086920282 (2h55m41.676265309s) [upload=3067]: Upload finished. err: <nil> Aug 7 12:36:20.993851564 (2h56m20.583196551s) [upload=3079]: Starting upload Aug 7 12:36:20.993913152 (2h56m20.583258139s) [upload=3079]: Done starting upload Aug 7 12:36:20.994018894 (2h56m20.583363882s) [upload=3079]: Uploading segments... Aug 7 12:36:20.994051757 (2h56m20.583396744s) [upload=3079]: Got next segment. Inline: true Aug 7 12:36:20.994066426 (2h56m20.583411413s) [upload=3079]: Waiting for error group managing segments... Aug 7 12:36:20.994102264 (2h56m20.583447241s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:36:20.994106041 (2h56m20.583451028s) [upload=3079]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:36:20.994108245 (2h56m20.583453222s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:36:21.296488949 (2h56m20.885833936s) [upload=3079]: Done uploading segments... Aug 7 12:36:21.296509168 (2h56m20.885854155s) [upload=3079]: Upload finished. err: <nil> Aug 7 12:37:22.483132350 (2h57m22.072477338s) [upload=3092]: Starting upload Aug 7 12:37:22.483185793 (2h57m22.07253077s) [upload=3092]: Done starting upload Aug 7 12:37:22.483245758 (2h57m22.072590745s) [upload=3092]: Uploading segments... Aug 7 12:37:22.483277098 (2h57m22.072622085s) [upload=3092]: Got next segment. Inline: true Aug 7 12:37:22.483281196 (2h57m22.072626183s) [upload=3092]: Waiting for error group managing segments... Aug 7 12:37:22.483316333 (2h57m22.07266132s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Duration:* 1.84151721s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X.........X........................X......] duration: 1.950256575s FAIL (2025-08-07 12:42:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== equestItem_SegmentMakeInline Aug 7 12:30:27.647630092 (2h50m27.236975079s) [upload=2977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:28.008882523 (2h50m27.5982275s) [upload=2977]: Done uploading segments... Aug 7 12:30:28.008902401 (2h50m27.598247388s) [upload=2977]: Upload finished. err: <nil> Aug 7 12:30:55.159551036 (2h50m54.748896023s) [upload=2983]: Starting upload Aug 7 12:30:55.159591593 (2h50m54.74893658s) [upload=2983]: Done starting upload Aug 7 12:30:55.159661457 (2h50m54.749006444s) [upload=2983]: Uploading segments... Aug 7 12:30:55.159694179 (2h50m54.749039166s) [upload=2983]: Got next segment. Inline: true Aug 7 12:30:55.159697997 (2h50m54.749042984s) [upload=2983]: Waiting for error group managing segments... Aug 7 12:30:55.159739876 (2h50m54.749084893s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:30:55.159748543 (2h50m54.749093571s) [upload=2983]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:30:55.159752260 (2h50m54.749097248s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:55.647163377 (2h50m55.236508364s) [upload=2983]: Done uploading segments... Aug 7 12:30:55.647181432 (2h50m55.236526419s) [upload=2983]: Upload finished. err: <nil> Aug 7 12:31:14.499749821 (2h51m14.089094808s) [upload=2989]: Starting upload Aug 7 12:31:14.499829994 (2h51m14.089174971s) [upload=2989]: Done starting upload Aug 7 12:31:14.499900079 (2h51m14.089245066s) [upload=2989]: Uploading segments... Aug 7 12:31:14.499988067 (2h51m14.089333084s) [upload=2989]: Got next segment. Inline: true Aug 7 12:31:14.499994629 (2h51m14.089339616s) [upload=2989]: Waiting for error group managing segments... Aug 7 12:31:14.500044325 (2h51m14.089389312s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:14.500050466 (2h51m14.089395503s) [upload=2989]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:14.500054143 (2h51m14.08939913s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:14.828960068 (2h51m14.418305065s) [upload=2989]: Done uploading segments... Aug 7 12:31:14.828985195 (2h51m14.418330202s) [upload=2989]: Upload finished. err: <nil> Aug 7 12:31:51.421138752 (2h51m51.010483749s) [upload=2999]: Starting upload Aug 7 12:31:51.421215367 (2h51m51.010560354s) [upload=2999]: Done starting upload Aug 7 12:31:51.421278529 (2h51m51.010623536s) [upload=2999]: Uploading segments... Aug 7 12:31:51.421324687 (2h51m51.010669704s) [upload=2999]: Got next segment. Inline: true Aug 7 12:31:51.421329817 (2h51m51.010674804s) [upload=2999]: Waiting for error group managing segments... Aug 7 12:31:51.421373751 (2h51m51.010718748s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:51.421378500 (2h51m51.010723497s) [upload=2999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:51.421382247 (2h51m51.010727254s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:51.741023086 (2h51m51.330368073s) [upload=2999]: Done uploading segments... Aug 7 12:31:51.741042363 (2h51m51.33038734s) [upload=2999]: Upload finished. err: <nil> Aug 7 12:33:06.378431966 (2h53m5.967776943s) [upload=3023]: Starting upload Aug 7 12:33:06.378479197 (2h53m5.967824174s) [upload=3023]: Done starting upload Aug 7 12:33:06.378544331 (2h53m5.967889318s) [upload=3023]: Uploading segments... Aug 7 12:33:06.378635907 (2h53m5.967980884s) [upload=3023]: Got next segment. Inline: true Aug 7 12:33:06.378640135 (2h53m5.967985112s) [upload=3023]: Waiting for error group managing segments... Aug 7 12:33:06.378683327 (2h53m5.968028314s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:06.378688106 (2h53m5.968033093s) [upload=3023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:06.378690431 (2h53m5.968035418s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:06.654130610 (2h53m6.243475597s) [upload=3023]: Done uploading segments... Aug 7 12:33:06.654148996 (2h53m6.243493973s) [upload=3023]: Upload finished. err: <nil> Aug 7 12:33:35.215249854 (2h53m34.804594841s) [upload=3031]: Starting upload Aug 7 12:33:35.215299758 (2h53m34.804644745s) [upload=3031]: Done starting upload Aug 7 12:33:35.215375503 (2h53m34.80472049s) [upload=3031]: Uploading segments... Aug 7 12:33:35.215408707 (2h53m34.804753694s) [upload=3031]: Got next segment. Inline: true Aug 7 12:33:35.215412754 (2h53m34.804757741s) [upload=3031]: Waiting for error group managing segments... Aug 7 12:33:35.215450507 (2h53m34.804795494s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:35.215454535 (2h53m34.804799522s) [upload=3031]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:35.215457069 (2h53m34.804802057s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:35.540448634 (2h53m35.129793621s) [upload=3031]: Done uploading segments... Aug 7 12:33:35.540468722 (2h53m35.129813709s) [upload=3031]: Upload finished. err: <nil> Aug 7 12:34:40.807496878 (2h54m40.396841865s) [upload=3048]: Starting upload Aug 7 12:34:40.807549308 (2h54m40.396894285s) [upload=3048]: Done starting upload Aug 7 12:34:40.807600165 (2h54m40.396945142s) [upload=3048]: Uploading segments... Aug 7 12:34:40.807631215 (2h54m40.396976202s) [upload=3048]: Got next segment. Inline: true Aug 7 12:34:40.807635593 (2h54m40.39698058s) [upload=3048]: Waiting for error group managing segments... Aug 7 12:34:40.807683445 (2h54m40.397028422s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:34:40.807687412 (2h54m40.397032399s) [upload=3048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:34:40.807689797 (2h54m40.397034784s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:34:41.098874490 (2h54m40.688219467s) [upload=3048]: Done uploading segments... Aug 7 12:34:41.098891382 (2h54m40.688236359s) [upload=3048]: Upload finished. err: <nil> Aug 7 12:35:41.631914876 (2h55m41.221259863s) [upload=3067]: Starting upload Aug 7 12:35:41.631989118 (2h55m41.221334115s) [upload=3067]: Done starting upload Aug 7 12:35:41.632049634 (2h55m41.221394621s) [upload=3067]: Uploading segments... Aug 7 12:35:41.632083659 (2h55m41.221428646s) [upload=3067]: Got next segment. Inline: true Aug 7 12:35:41.632088899 (2h55m41.221433886s) [upload=3067]: Waiting for error group managing segments... Aug 7 12:35:41.632123766 (2h55m41.221468743s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:35:41.632127503 (2h55m41.22147249s) [upload=3067]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:35:41.632129787 (2h55m41.221474774s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:35:42.086896186 (2h55m41.676241253s) [upload=3067]: Done uploading segments... Aug 7 12:35:42.086920282 (2h55m41.676265309s) [upload=3067]: Upload finished. err: <nil> Aug 7 12:36:20.993851564 (2h56m20.583196551s) [upload=3079]: Starting upload Aug 7 12:36:20.993913152 (2h56m20.583258139s) [upload=3079]: Done starting upload Aug 7 12:36:20.994018894 (2h56m20.583363882s) [upload=3079]: Uploading segments... Aug 7 12:36:20.994051757 (2h56m20.583396744s) [upload=3079]: Got next segment. Inline: true Aug 7 12:36:20.994066426 (2h56m20.583411413s) [upload=3079]: Waiting for error group managing segments... Aug 7 12:36:20.994102264 (2h56m20.583447241s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:36:20.994106041 (2h56m20.583451028s) [upload=3079]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:36:20.994108245 (2h56m20.583453222s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:36:21.296488949 (2h56m20.885833936s) [upload=3079]: Done uploading segments... Aug 7 12:36:21.296509168 (2h56m20.885854155s) [upload=3079]: Upload finished. err: <nil> Aug 7 12:37:22.483132350 (2h57m22.072477338s) [upload=3092]: Starting upload Aug 7 12:37:22.483185793 (2h57m22.07253077s) [upload=3092]: Done starting upload Aug 7 12:37:22.483245758 (2h57m22.072590745s) [upload=3092]: Uploading segments... Aug 7 12:37:22.483277098 (2h57m22.072622085s) [upload=3092]: Got next segment. Inline: true Aug 7 12:37:22.483281196 (2h57m22.072626183s) [upload=3092]: Waiting for error group managing segments... Aug 7 12:37:22.483316333 (2h57m22.07266132s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Duration:* 1.950323964s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X.........X........................X.....] duration: 1.885098741s FAIL (2025-08-07 12:41:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== equestItem_SegmentMakeInline Aug 7 12:30:27.647630092 (2h50m27.236975079s) [upload=2977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:28.008882523 (2h50m27.5982275s) [upload=2977]: Done uploading segments... Aug 7 12:30:28.008902401 (2h50m27.598247388s) [upload=2977]: Upload finished. err: <nil> Aug 7 12:30:55.159551036 (2h50m54.748896023s) [upload=2983]: Starting upload Aug 7 12:30:55.159591593 (2h50m54.74893658s) [upload=2983]: Done starting upload Aug 7 12:30:55.159661457 (2h50m54.749006444s) [upload=2983]: Uploading segments... Aug 7 12:30:55.159694179 (2h50m54.749039166s) [upload=2983]: Got next segment. Inline: true Aug 7 12:30:55.159697997 (2h50m54.749042984s) [upload=2983]: Waiting for error group managing segments... Aug 7 12:30:55.159739876 (2h50m54.749084893s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:30:55.159748543 (2h50m54.749093571s) [upload=2983]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:30:55.159752260 (2h50m54.749097248s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:55.647163377 (2h50m55.236508364s) [upload=2983]: Done uploading segments... Aug 7 12:30:55.647181432 (2h50m55.236526419s) [upload=2983]: Upload finished. err: <nil> Aug 7 12:31:14.499749821 (2h51m14.089094808s) [upload=2989]: Starting upload Aug 7 12:31:14.499829994 (2h51m14.089174971s) [upload=2989]: Done starting upload Aug 7 12:31:14.499900079 (2h51m14.089245066s) [upload=2989]: Uploading segments... Aug 7 12:31:14.499988067 (2h51m14.089333084s) [upload=2989]: Got next segment. Inline: true Aug 7 12:31:14.499994629 (2h51m14.089339616s) [upload=2989]: Waiting for error group managing segments... Aug 7 12:31:14.500044325 (2h51m14.089389312s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:14.500050466 (2h51m14.089395503s) [upload=2989]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:14.500054143 (2h51m14.08939913s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:14.828960068 (2h51m14.418305065s) [upload=2989]: Done uploading segments... Aug 7 12:31:14.828985195 (2h51m14.418330202s) [upload=2989]: Upload finished. err: <nil> Aug 7 12:31:51.421138752 (2h51m51.010483749s) [upload=2999]: Starting upload Aug 7 12:31:51.421215367 (2h51m51.010560354s) [upload=2999]: Done starting upload Aug 7 12:31:51.421278529 (2h51m51.010623536s) [upload=2999]: Uploading segments... Aug 7 12:31:51.421324687 (2h51m51.010669704s) [upload=2999]: Got next segment. Inline: true Aug 7 12:31:51.421329817 (2h51m51.010674804s) [upload=2999]: Waiting for error group managing segments... Aug 7 12:31:51.421373751 (2h51m51.010718748s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:51.421378500 (2h51m51.010723497s) [upload=2999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:51.421382247 (2h51m51.010727254s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:51.741023086 (2h51m51.330368073s) [upload=2999]: Done uploading segments... Aug 7 12:31:51.741042363 (2h51m51.33038734s) [upload=2999]: Upload finished. err: <nil> Aug 7 12:33:06.378431966 (2h53m5.967776943s) [upload=3023]: Starting upload Aug 7 12:33:06.378479197 (2h53m5.967824174s) [upload=3023]: Done starting upload Aug 7 12:33:06.378544331 (2h53m5.967889318s) [upload=3023]: Uploading segments... Aug 7 12:33:06.378635907 (2h53m5.967980884s) [upload=3023]: Got next segment. Inline: true Aug 7 12:33:06.378640135 (2h53m5.967985112s) [upload=3023]: Waiting for error group managing segments... Aug 7 12:33:06.378683327 (2h53m5.968028314s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:06.378688106 (2h53m5.968033093s) [upload=3023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:06.378690431 (2h53m5.968035418s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:06.654130610 (2h53m6.243475597s) [upload=3023]: Done uploading segments... Aug 7 12:33:06.654148996 (2h53m6.243493973s) [upload=3023]: Upload finished. err: <nil> Aug 7 12:33:35.215249854 (2h53m34.804594841s) [upload=3031]: Starting upload Aug 7 12:33:35.215299758 (2h53m34.804644745s) [upload=3031]: Done starting upload Aug 7 12:33:35.215375503 (2h53m34.80472049s) [upload=3031]: Uploading segments... Aug 7 12:33:35.215408707 (2h53m34.804753694s) [upload=3031]: Got next segment. Inline: true Aug 7 12:33:35.215412754 (2h53m34.804757741s) [upload=3031]: Waiting for error group managing segments... Aug 7 12:33:35.215450507 (2h53m34.804795494s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:35.215454535 (2h53m34.804799522s) [upload=3031]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:35.215457069 (2h53m34.804802057s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:35.540448634 (2h53m35.129793621s) [upload=3031]: Done uploading segments... Aug 7 12:33:35.540468722 (2h53m35.129813709s) [upload=3031]: Upload finished. err: <nil> Aug 7 12:34:40.807496878 (2h54m40.396841865s) [upload=3048]: Starting upload Aug 7 12:34:40.807549308 (2h54m40.396894285s) [upload=3048]: Done starting upload Aug 7 12:34:40.807600165 (2h54m40.396945142s) [upload=3048]: Uploading segments... Aug 7 12:34:40.807631215 (2h54m40.396976202s) [upload=3048]: Got next segment. Inline: true Aug 7 12:34:40.807635593 (2h54m40.39698058s) [upload=3048]: Waiting for error group managing segments... Aug 7 12:34:40.807683445 (2h54m40.397028422s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:34:40.807687412 (2h54m40.397032399s) [upload=3048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:34:40.807689797 (2h54m40.397034784s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:34:41.098874490 (2h54m40.688219467s) [upload=3048]: Done uploading segments... Aug 7 12:34:41.098891382 (2h54m40.688236359s) [upload=3048]: Upload finished. err: <nil> Aug 7 12:35:41.631914876 (2h55m41.221259863s) [upload=3067]: Starting upload Aug 7 12:35:41.631989118 (2h55m41.221334115s) [upload=3067]: Done starting upload Aug 7 12:35:41.632049634 (2h55m41.221394621s) [upload=3067]: Uploading segments... Aug 7 12:35:41.632083659 (2h55m41.221428646s) [upload=3067]: Got next segment. Inline: true Aug 7 12:35:41.632088899 (2h55m41.221433886s) [upload=3067]: Waiting for error group managing segments... Aug 7 12:35:41.632123766 (2h55m41.221468743s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:35:41.632127503 (2h55m41.22147249s) [upload=3067]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:35:41.632129787 (2h55m41.221474774s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:35:42.086896186 (2h55m41.676241253s) [upload=3067]: Done uploading segments... Aug 7 12:35:42.086920282 (2h55m41.676265309s) [upload=3067]: Upload finished. err: <nil> Aug 7 12:36:20.993851564 (2h56m20.583196551s) [upload=3079]: Starting upload Aug 7 12:36:20.993913152 (2h56m20.583258139s) [upload=3079]: Done starting upload Aug 7 12:36:20.994018894 (2h56m20.583363882s) [upload=3079]: Uploading segments... Aug 7 12:36:20.994051757 (2h56m20.583396744s) [upload=3079]: Got next segment. Inline: true Aug 7 12:36:20.994066426 (2h56m20.583411413s) [upload=3079]: Waiting for error group managing segments... Aug 7 12:36:20.994102264 (2h56m20.583447241s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:36:20.994106041 (2h56m20.583451028s) [upload=3079]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:36:20.994108245 (2h56m20.583453222s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:36:21.296488949 (2h56m20.885833936s) [upload=3079]: Done uploading segments... Aug 7 12:36:21.296509168 (2h56m20.885854155s) [upload=3079]: Upload finished. err: <nil> Aug 7 12:37:22.483132350 (2h57m22.072477338s) [upload=3092]: Starting upload Aug 7 12:37:22.483185793 (2h57m22.07253077s) [upload=3092]: Done starting upload Aug 7 12:37:22.483245758 (2h57m22.072590745s) [upload=3092]: Uploading segments... Aug 7 12:37:22.483277098 (2h57m22.072622085s) [upload=3092]: Got next segment. Inline: true Aug 7 12:37:22.483281196 (2h57m22.072626183s) [upload=3092]: Waiting for error group managing segments... Aug 7 12:37:22.483316333 (2h57m22.07266132s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Duration:* 1.885122766s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X.........X........................X....] duration: 1.859914607s FAIL (2025-08-07 12:40:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== equestItem_SegmentMakeInline Aug 7 12:30:27.647630092 (2h50m27.236975079s) [upload=2977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:28.008882523 (2h50m27.5982275s) [upload=2977]: Done uploading segments... Aug 7 12:30:28.008902401 (2h50m27.598247388s) [upload=2977]: Upload finished. err: <nil> Aug 7 12:30:55.159551036 (2h50m54.748896023s) [upload=2983]: Starting upload Aug 7 12:30:55.159591593 (2h50m54.74893658s) [upload=2983]: Done starting upload Aug 7 12:30:55.159661457 (2h50m54.749006444s) [upload=2983]: Uploading segments... Aug 7 12:30:55.159694179 (2h50m54.749039166s) [upload=2983]: Got next segment. Inline: true Aug 7 12:30:55.159697997 (2h50m54.749042984s) [upload=2983]: Waiting for error group managing segments... Aug 7 12:30:55.159739876 (2h50m54.749084893s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:30:55.159748543 (2h50m54.749093571s) [upload=2983]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:30:55.159752260 (2h50m54.749097248s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:55.647163377 (2h50m55.236508364s) [upload=2983]: Done uploading segments... Aug 7 12:30:55.647181432 (2h50m55.236526419s) [upload=2983]: Upload finished. err: <nil> Aug 7 12:31:14.499749821 (2h51m14.089094808s) [upload=2989]: Starting upload Aug 7 12:31:14.499829994 (2h51m14.089174971s) [upload=2989]: Done starting upload Aug 7 12:31:14.499900079 (2h51m14.089245066s) [upload=2989]: Uploading segments... Aug 7 12:31:14.499988067 (2h51m14.089333084s) [upload=2989]: Got next segment. Inline: true Aug 7 12:31:14.499994629 (2h51m14.089339616s) [upload=2989]: Waiting for error group managing segments... Aug 7 12:31:14.500044325 (2h51m14.089389312s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:14.500050466 (2h51m14.089395503s) [upload=2989]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:14.500054143 (2h51m14.08939913s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:14.828960068 (2h51m14.418305065s) [upload=2989]: Done uploading segments... Aug 7 12:31:14.828985195 (2h51m14.418330202s) [upload=2989]: Upload finished. err: <nil> Aug 7 12:31:51.421138752 (2h51m51.010483749s) [upload=2999]: Starting upload Aug 7 12:31:51.421215367 (2h51m51.010560354s) [upload=2999]: Done starting upload Aug 7 12:31:51.421278529 (2h51m51.010623536s) [upload=2999]: Uploading segments... Aug 7 12:31:51.421324687 (2h51m51.010669704s) [upload=2999]: Got next segment. Inline: true Aug 7 12:31:51.421329817 (2h51m51.010674804s) [upload=2999]: Waiting for error group managing segments... Aug 7 12:31:51.421373751 (2h51m51.010718748s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:51.421378500 (2h51m51.010723497s) [upload=2999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:51.421382247 (2h51m51.010727254s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:51.741023086 (2h51m51.330368073s) [upload=2999]: Done uploading segments... Aug 7 12:31:51.741042363 (2h51m51.33038734s) [upload=2999]: Upload finished. err: <nil> Aug 7 12:33:06.378431966 (2h53m5.967776943s) [upload=3023]: Starting upload Aug 7 12:33:06.378479197 (2h53m5.967824174s) [upload=3023]: Done starting upload Aug 7 12:33:06.378544331 (2h53m5.967889318s) [upload=3023]: Uploading segments... Aug 7 12:33:06.378635907 (2h53m5.967980884s) [upload=3023]: Got next segment. Inline: true Aug 7 12:33:06.378640135 (2h53m5.967985112s) [upload=3023]: Waiting for error group managing segments... Aug 7 12:33:06.378683327 (2h53m5.968028314s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:06.378688106 (2h53m5.968033093s) [upload=3023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:06.378690431 (2h53m5.968035418s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:06.654130610 (2h53m6.243475597s) [upload=3023]: Done uploading segments... Aug 7 12:33:06.654148996 (2h53m6.243493973s) [upload=3023]: Upload finished. err: <nil> Aug 7 12:33:35.215249854 (2h53m34.804594841s) [upload=3031]: Starting upload Aug 7 12:33:35.215299758 (2h53m34.804644745s) [upload=3031]: Done starting upload Aug 7 12:33:35.215375503 (2h53m34.80472049s) [upload=3031]: Uploading segments... Aug 7 12:33:35.215408707 (2h53m34.804753694s) [upload=3031]: Got next segment. Inline: true Aug 7 12:33:35.215412754 (2h53m34.804757741s) [upload=3031]: Waiting for error group managing segments... Aug 7 12:33:35.215450507 (2h53m34.804795494s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:35.215454535 (2h53m34.804799522s) [upload=3031]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:35.215457069 (2h53m34.804802057s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:35.540448634 (2h53m35.129793621s) [upload=3031]: Done uploading segments... Aug 7 12:33:35.540468722 (2h53m35.129813709s) [upload=3031]: Upload finished. err: <nil> Aug 7 12:34:40.807496878 (2h54m40.396841865s) [upload=3048]: Starting upload Aug 7 12:34:40.807549308 (2h54m40.396894285s) [upload=3048]: Done starting upload Aug 7 12:34:40.807600165 (2h54m40.396945142s) [upload=3048]: Uploading segments... Aug 7 12:34:40.807631215 (2h54m40.396976202s) [upload=3048]: Got next segment. Inline: true Aug 7 12:34:40.807635593 (2h54m40.39698058s) [upload=3048]: Waiting for error group managing segments... Aug 7 12:34:40.807683445 (2h54m40.397028422s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:34:40.807687412 (2h54m40.397032399s) [upload=3048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:34:40.807689797 (2h54m40.397034784s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:34:41.098874490 (2h54m40.688219467s) [upload=3048]: Done uploading segments... Aug 7 12:34:41.098891382 (2h54m40.688236359s) [upload=3048]: Upload finished. err: <nil> Aug 7 12:35:41.631914876 (2h55m41.221259863s) [upload=3067]: Starting upload Aug 7 12:35:41.631989118 (2h55m41.221334115s) [upload=3067]: Done starting upload Aug 7 12:35:41.632049634 (2h55m41.221394621s) [upload=3067]: Uploading segments... Aug 7 12:35:41.632083659 (2h55m41.221428646s) [upload=3067]: Got next segment. Inline: true Aug 7 12:35:41.632088899 (2h55m41.221433886s) [upload=3067]: Waiting for error group managing segments... Aug 7 12:35:41.632123766 (2h55m41.221468743s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:35:41.632127503 (2h55m41.22147249s) [upload=3067]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:35:41.632129787 (2h55m41.221474774s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:35:42.086896186 (2h55m41.676241253s) [upload=3067]: Done uploading segments... Aug 7 12:35:42.086920282 (2h55m41.676265309s) [upload=3067]: Upload finished. err: <nil> Aug 7 12:36:20.993851564 (2h56m20.583196551s) [upload=3079]: Starting upload Aug 7 12:36:20.993913152 (2h56m20.583258139s) [upload=3079]: Done starting upload Aug 7 12:36:20.994018894 (2h56m20.583363882s) [upload=3079]: Uploading segments... Aug 7 12:36:20.994051757 (2h56m20.583396744s) [upload=3079]: Got next segment. Inline: true Aug 7 12:36:20.994066426 (2h56m20.583411413s) [upload=3079]: Waiting for error group managing segments... Aug 7 12:36:20.994102264 (2h56m20.583447241s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:36:20.994106041 (2h56m20.583451028s) [upload=3079]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:36:20.994108245 (2h56m20.583453222s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:36:21.296488949 (2h56m20.885833936s) [upload=3079]: Done uploading segments... Aug 7 12:36:21.296509168 (2h56m20.885854155s) [upload=3079]: Upload finished. err: <nil> Aug 7 12:37:22.483132350 (2h57m22.072477338s) [upload=3092]: Starting upload Aug 7 12:37:22.483185793 (2h57m22.07253077s) [upload=3092]: Done starting upload Aug 7 12:37:22.483245758 (2h57m22.072590745s) [upload=3092]: Uploading segments... Aug 7 12:37:22.483277098 (2h57m22.072622085s) [upload=3092]: Got next segment. Inline: true Aug 7 12:37:22.483281196 (2h57m22.072626183s) [upload=3092]: Waiting for error group managing segments... Aug 7 12:37:22.483316333 (2h57m22.07266132s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Duration:* 1.859951757s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.........X........................X...] duration: 1.843337583s FAIL (2025-08-07 12:39:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== equestItem_SegmentMakeInline Aug 7 12:30:27.647630092 (2h50m27.236975079s) [upload=2977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:28.008882523 (2h50m27.5982275s) [upload=2977]: Done uploading segments... Aug 7 12:30:28.008902401 (2h50m27.598247388s) [upload=2977]: Upload finished. err: <nil> Aug 7 12:30:55.159551036 (2h50m54.748896023s) [upload=2983]: Starting upload Aug 7 12:30:55.159591593 (2h50m54.74893658s) [upload=2983]: Done starting upload Aug 7 12:30:55.159661457 (2h50m54.749006444s) [upload=2983]: Uploading segments... Aug 7 12:30:55.159694179 (2h50m54.749039166s) [upload=2983]: Got next segment. Inline: true Aug 7 12:30:55.159697997 (2h50m54.749042984s) [upload=2983]: Waiting for error group managing segments... Aug 7 12:30:55.159739876 (2h50m54.749084893s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:30:55.159748543 (2h50m54.749093571s) [upload=2983]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:30:55.159752260 (2h50m54.749097248s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:55.647163377 (2h50m55.236508364s) [upload=2983]: Done uploading segments... Aug 7 12:30:55.647181432 (2h50m55.236526419s) [upload=2983]: Upload finished. err: <nil> Aug 7 12:31:14.499749821 (2h51m14.089094808s) [upload=2989]: Starting upload Aug 7 12:31:14.499829994 (2h51m14.089174971s) [upload=2989]: Done starting upload Aug 7 12:31:14.499900079 (2h51m14.089245066s) [upload=2989]: Uploading segments... Aug 7 12:31:14.499988067 (2h51m14.089333084s) [upload=2989]: Got next segment. Inline: true Aug 7 12:31:14.499994629 (2h51m14.089339616s) [upload=2989]: Waiting for error group managing segments... Aug 7 12:31:14.500044325 (2h51m14.089389312s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:14.500050466 (2h51m14.089395503s) [upload=2989]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:14.500054143 (2h51m14.08939913s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:14.828960068 (2h51m14.418305065s) [upload=2989]: Done uploading segments... Aug 7 12:31:14.828985195 (2h51m14.418330202s) [upload=2989]: Upload finished. err: <nil> Aug 7 12:31:51.421138752 (2h51m51.010483749s) [upload=2999]: Starting upload Aug 7 12:31:51.421215367 (2h51m51.010560354s) [upload=2999]: Done starting upload Aug 7 12:31:51.421278529 (2h51m51.010623536s) [upload=2999]: Uploading segments... Aug 7 12:31:51.421324687 (2h51m51.010669704s) [upload=2999]: Got next segment. Inline: true Aug 7 12:31:51.421329817 (2h51m51.010674804s) [upload=2999]: Waiting for error group managing segments... Aug 7 12:31:51.421373751 (2h51m51.010718748s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:51.421378500 (2h51m51.010723497s) [upload=2999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:51.421382247 (2h51m51.010727254s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:51.741023086 (2h51m51.330368073s) [upload=2999]: Done uploading segments... Aug 7 12:31:51.741042363 (2h51m51.33038734s) [upload=2999]: Upload finished. err: <nil> Aug 7 12:33:06.378431966 (2h53m5.967776943s) [upload=3023]: Starting upload Aug 7 12:33:06.378479197 (2h53m5.967824174s) [upload=3023]: Done starting upload Aug 7 12:33:06.378544331 (2h53m5.967889318s) [upload=3023]: Uploading segments... Aug 7 12:33:06.378635907 (2h53m5.967980884s) [upload=3023]: Got next segment. Inline: true Aug 7 12:33:06.378640135 (2h53m5.967985112s) [upload=3023]: Waiting for error group managing segments... Aug 7 12:33:06.378683327 (2h53m5.968028314s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:06.378688106 (2h53m5.968033093s) [upload=3023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:06.378690431 (2h53m5.968035418s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:06.654130610 (2h53m6.243475597s) [upload=3023]: Done uploading segments... Aug 7 12:33:06.654148996 (2h53m6.243493973s) [upload=3023]: Upload finished. err: <nil> Aug 7 12:33:35.215249854 (2h53m34.804594841s) [upload=3031]: Starting upload Aug 7 12:33:35.215299758 (2h53m34.804644745s) [upload=3031]: Done starting upload Aug 7 12:33:35.215375503 (2h53m34.80472049s) [upload=3031]: Uploading segments... Aug 7 12:33:35.215408707 (2h53m34.804753694s) [upload=3031]: Got next segment. Inline: true Aug 7 12:33:35.215412754 (2h53m34.804757741s) [upload=3031]: Waiting for error group managing segments... Aug 7 12:33:35.215450507 (2h53m34.804795494s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:35.215454535 (2h53m34.804799522s) [upload=3031]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:35.215457069 (2h53m34.804802057s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:35.540448634 (2h53m35.129793621s) [upload=3031]: Done uploading segments... Aug 7 12:33:35.540468722 (2h53m35.129813709s) [upload=3031]: Upload finished. err: <nil> Aug 7 12:34:40.807496878 (2h54m40.396841865s) [upload=3048]: Starting upload Aug 7 12:34:40.807549308 (2h54m40.396894285s) [upload=3048]: Done starting upload Aug 7 12:34:40.807600165 (2h54m40.396945142s) [upload=3048]: Uploading segments... Aug 7 12:34:40.807631215 (2h54m40.396976202s) [upload=3048]: Got next segment. Inline: true Aug 7 12:34:40.807635593 (2h54m40.39698058s) [upload=3048]: Waiting for error group managing segments... Aug 7 12:34:40.807683445 (2h54m40.397028422s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:34:40.807687412 (2h54m40.397032399s) [upload=3048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:34:40.807689797 (2h54m40.397034784s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:34:41.098874490 (2h54m40.688219467s) [upload=3048]: Done uploading segments... Aug 7 12:34:41.098891382 (2h54m40.688236359s) [upload=3048]: Upload finished. err: <nil> Aug 7 12:35:41.631914876 (2h55m41.221259863s) [upload=3067]: Starting upload Aug 7 12:35:41.631989118 (2h55m41.221334115s) [upload=3067]: Done starting upload Aug 7 12:35:41.632049634 (2h55m41.221394621s) [upload=3067]: Uploading segments... Aug 7 12:35:41.632083659 (2h55m41.221428646s) [upload=3067]: Got next segment. Inline: true Aug 7 12:35:41.632088899 (2h55m41.221433886s) [upload=3067]: Waiting for error group managing segments... Aug 7 12:35:41.632123766 (2h55m41.221468743s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:35:41.632127503 (2h55m41.22147249s) [upload=3067]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:35:41.632129787 (2h55m41.221474774s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:35:42.086896186 (2h55m41.676241253s) [upload=3067]: Done uploading segments... Aug 7 12:35:42.086920282 (2h55m41.676265309s) [upload=3067]: Upload finished. err: <nil> Aug 7 12:36:20.993851564 (2h56m20.583196551s) [upload=3079]: Starting upload Aug 7 12:36:20.993913152 (2h56m20.583258139s) [upload=3079]: Done starting upload Aug 7 12:36:20.994018894 (2h56m20.583363882s) [upload=3079]: Uploading segments... Aug 7 12:36:20.994051757 (2h56m20.583396744s) [upload=3079]: Got next segment. Inline: true Aug 7 12:36:20.994066426 (2h56m20.583411413s) [upload=3079]: Waiting for error group managing segments... Aug 7 12:36:20.994102264 (2h56m20.583447241s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:36:20.994106041 (2h56m20.583451028s) [upload=3079]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:36:20.994108245 (2h56m20.583453222s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:36:21.296488949 (2h56m20.885833936s) [upload=3079]: Done uploading segments... Aug 7 12:36:21.296509168 (2h56m20.885854155s) [upload=3079]: Upload finished. err: <nil> Aug 7 12:37:22.483132350 (2h57m22.072477338s) [upload=3092]: Starting upload Aug 7 12:37:22.483185793 (2h57m22.07253077s) [upload=3092]: Done starting upload Aug 7 12:37:22.483245758 (2h57m22.072590745s) [upload=3092]: Uploading segments... Aug 7 12:37:22.483277098 (2h57m22.072622085s) [upload=3092]: Got next segment. Inline: true Aug 7 12:37:22.483281196 (2h57m22.072626183s) [upload=3092]: Waiting for error group managing segments... Aug 7 12:37:22.483316333 (2h57m22.07266132s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Duration:* 1.843360927s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X.........X........................X..] duration: 1.841917597s FAIL (2025-08-07 12:39:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== equestItem_SegmentMakeInline Aug 7 12:30:27.647630092 (2h50m27.236975079s) [upload=2977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:28.008882523 (2h50m27.5982275s) [upload=2977]: Done uploading segments... Aug 7 12:30:28.008902401 (2h50m27.598247388s) [upload=2977]: Upload finished. err: <nil> Aug 7 12:30:55.159551036 (2h50m54.748896023s) [upload=2983]: Starting upload Aug 7 12:30:55.159591593 (2h50m54.74893658s) [upload=2983]: Done starting upload Aug 7 12:30:55.159661457 (2h50m54.749006444s) [upload=2983]: Uploading segments... Aug 7 12:30:55.159694179 (2h50m54.749039166s) [upload=2983]: Got next segment. Inline: true Aug 7 12:30:55.159697997 (2h50m54.749042984s) [upload=2983]: Waiting for error group managing segments... Aug 7 12:30:55.159739876 (2h50m54.749084893s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:30:55.159748543 (2h50m54.749093571s) [upload=2983]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:30:55.159752260 (2h50m54.749097248s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:55.647163377 (2h50m55.236508364s) [upload=2983]: Done uploading segments... Aug 7 12:30:55.647181432 (2h50m55.236526419s) [upload=2983]: Upload finished. err: <nil> Aug 7 12:31:14.499749821 (2h51m14.089094808s) [upload=2989]: Starting upload Aug 7 12:31:14.499829994 (2h51m14.089174971s) [upload=2989]: Done starting upload Aug 7 12:31:14.499900079 (2h51m14.089245066s) [upload=2989]: Uploading segments... Aug 7 12:31:14.499988067 (2h51m14.089333084s) [upload=2989]: Got next segment. Inline: true Aug 7 12:31:14.499994629 (2h51m14.089339616s) [upload=2989]: Waiting for error group managing segments... Aug 7 12:31:14.500044325 (2h51m14.089389312s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:14.500050466 (2h51m14.089395503s) [upload=2989]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:14.500054143 (2h51m14.08939913s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:14.828960068 (2h51m14.418305065s) [upload=2989]: Done uploading segments... Aug 7 12:31:14.828985195 (2h51m14.418330202s) [upload=2989]: Upload finished. err: <nil> Aug 7 12:31:51.421138752 (2h51m51.010483749s) [upload=2999]: Starting upload Aug 7 12:31:51.421215367 (2h51m51.010560354s) [upload=2999]: Done starting upload Aug 7 12:31:51.421278529 (2h51m51.010623536s) [upload=2999]: Uploading segments... Aug 7 12:31:51.421324687 (2h51m51.010669704s) [upload=2999]: Got next segment. Inline: true Aug 7 12:31:51.421329817 (2h51m51.010674804s) [upload=2999]: Waiting for error group managing segments... Aug 7 12:31:51.421373751 (2h51m51.010718748s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:51.421378500 (2h51m51.010723497s) [upload=2999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:51.421382247 (2h51m51.010727254s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:51.741023086 (2h51m51.330368073s) [upload=2999]: Done uploading segments... Aug 7 12:31:51.741042363 (2h51m51.33038734s) [upload=2999]: Upload finished. err: <nil> Aug 7 12:33:06.378431966 (2h53m5.967776943s) [upload=3023]: Starting upload Aug 7 12:33:06.378479197 (2h53m5.967824174s) [upload=3023]: Done starting upload Aug 7 12:33:06.378544331 (2h53m5.967889318s) [upload=3023]: Uploading segments... Aug 7 12:33:06.378635907 (2h53m5.967980884s) [upload=3023]: Got next segment. Inline: true Aug 7 12:33:06.378640135 (2h53m5.967985112s) [upload=3023]: Waiting for error group managing segments... Aug 7 12:33:06.378683327 (2h53m5.968028314s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:06.378688106 (2h53m5.968033093s) [upload=3023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:06.378690431 (2h53m5.968035418s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:06.654130610 (2h53m6.243475597s) [upload=3023]: Done uploading segments... Aug 7 12:33:06.654148996 (2h53m6.243493973s) [upload=3023]: Upload finished. err: <nil> Aug 7 12:33:35.215249854 (2h53m34.804594841s) [upload=3031]: Starting upload Aug 7 12:33:35.215299758 (2h53m34.804644745s) [upload=3031]: Done starting upload Aug 7 12:33:35.215375503 (2h53m34.80472049s) [upload=3031]: Uploading segments... Aug 7 12:33:35.215408707 (2h53m34.804753694s) [upload=3031]: Got next segment. Inline: true Aug 7 12:33:35.215412754 (2h53m34.804757741s) [upload=3031]: Waiting for error group managing segments... Aug 7 12:33:35.215450507 (2h53m34.804795494s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:35.215454535 (2h53m34.804799522s) [upload=3031]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:35.215457069 (2h53m34.804802057s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:35.540448634 (2h53m35.129793621s) [upload=3031]: Done uploading segments... Aug 7 12:33:35.540468722 (2h53m35.129813709s) [upload=3031]: Upload finished. err: <nil> Aug 7 12:34:40.807496878 (2h54m40.396841865s) [upload=3048]: Starting upload Aug 7 12:34:40.807549308 (2h54m40.396894285s) [upload=3048]: Done starting upload Aug 7 12:34:40.807600165 (2h54m40.396945142s) [upload=3048]: Uploading segments... Aug 7 12:34:40.807631215 (2h54m40.396976202s) [upload=3048]: Got next segment. Inline: true Aug 7 12:34:40.807635593 (2h54m40.39698058s) [upload=3048]: Waiting for error group managing segments... Aug 7 12:34:40.807683445 (2h54m40.397028422s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:34:40.807687412 (2h54m40.397032399s) [upload=3048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:34:40.807689797 (2h54m40.397034784s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:34:41.098874490 (2h54m40.688219467s) [upload=3048]: Done uploading segments... Aug 7 12:34:41.098891382 (2h54m40.688236359s) [upload=3048]: Upload finished. err: <nil> Aug 7 12:35:41.631914876 (2h55m41.221259863s) [upload=3067]: Starting upload Aug 7 12:35:41.631989118 (2h55m41.221334115s) [upload=3067]: Done starting upload Aug 7 12:35:41.632049634 (2h55m41.221394621s) [upload=3067]: Uploading segments... Aug 7 12:35:41.632083659 (2h55m41.221428646s) [upload=3067]: Got next segment. Inline: true Aug 7 12:35:41.632088899 (2h55m41.221433886s) [upload=3067]: Waiting for error group managing segments... Aug 7 12:35:41.632123766 (2h55m41.221468743s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:35:41.632127503 (2h55m41.22147249s) [upload=3067]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:35:41.632129787 (2h55m41.221474774s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:35:42.086896186 (2h55m41.676241253s) [upload=3067]: Done uploading segments... Aug 7 12:35:42.086920282 (2h55m41.676265309s) [upload=3067]: Upload finished. err: <nil> Aug 7 12:36:20.993851564 (2h56m20.583196551s) [upload=3079]: Starting upload Aug 7 12:36:20.993913152 (2h56m20.583258139s) [upload=3079]: Done starting upload Aug 7 12:36:20.994018894 (2h56m20.583363882s) [upload=3079]: Uploading segments... Aug 7 12:36:20.994051757 (2h56m20.583396744s) [upload=3079]: Got next segment. Inline: true Aug 7 12:36:20.994066426 (2h56m20.583411413s) [upload=3079]: Waiting for error group managing segments... Aug 7 12:36:20.994102264 (2h56m20.583447241s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:36:20.994106041 (2h56m20.583451028s) [upload=3079]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:36:20.994108245 (2h56m20.583453222s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:36:21.296488949 (2h56m20.885833936s) [upload=3079]: Done uploading segments... Aug 7 12:36:21.296509168 (2h56m20.885854155s) [upload=3079]: Upload finished. err: <nil> Aug 7 12:37:22.483132350 (2h57m22.072477338s) [upload=3092]: Starting upload Aug 7 12:37:22.483185793 (2h57m22.07253077s) [upload=3092]: Done starting upload Aug 7 12:37:22.483245758 (2h57m22.072590745s) [upload=3092]: Uploading segments... Aug 7 12:37:22.483277098 (2h57m22.072622085s) [upload=3092]: Got next segment. Inline: true Aug 7 12:37:22.483281196 (2h57m22.072626183s) [upload=3092]: Waiting for error group managing segments... Aug 7 12:37:22.483316333 (2h57m22.07266132s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Duration:* 1.841942485s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.........X........................X.] duration: 1.920775424s FAIL (2025-08-07 12:38:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== equestItem_SegmentMakeInline Aug 7 12:30:27.647630092 (2h50m27.236975079s) [upload=2977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:28.008882523 (2h50m27.5982275s) [upload=2977]: Done uploading segments... Aug 7 12:30:28.008902401 (2h50m27.598247388s) [upload=2977]: Upload finished. err: <nil> Aug 7 12:30:55.159551036 (2h50m54.748896023s) [upload=2983]: Starting upload Aug 7 12:30:55.159591593 (2h50m54.74893658s) [upload=2983]: Done starting upload Aug 7 12:30:55.159661457 (2h50m54.749006444s) [upload=2983]: Uploading segments... Aug 7 12:30:55.159694179 (2h50m54.749039166s) [upload=2983]: Got next segment. Inline: true Aug 7 12:30:55.159697997 (2h50m54.749042984s) [upload=2983]: Waiting for error group managing segments... Aug 7 12:30:55.159739876 (2h50m54.749084893s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:30:55.159748543 (2h50m54.749093571s) [upload=2983]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:30:55.159752260 (2h50m54.749097248s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:55.647163377 (2h50m55.236508364s) [upload=2983]: Done uploading segments... Aug 7 12:30:55.647181432 (2h50m55.236526419s) [upload=2983]: Upload finished. err: <nil> Aug 7 12:31:14.499749821 (2h51m14.089094808s) [upload=2989]: Starting upload Aug 7 12:31:14.499829994 (2h51m14.089174971s) [upload=2989]: Done starting upload Aug 7 12:31:14.499900079 (2h51m14.089245066s) [upload=2989]: Uploading segments... Aug 7 12:31:14.499988067 (2h51m14.089333084s) [upload=2989]: Got next segment. Inline: true Aug 7 12:31:14.499994629 (2h51m14.089339616s) [upload=2989]: Waiting for error group managing segments... Aug 7 12:31:14.500044325 (2h51m14.089389312s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:14.500050466 (2h51m14.089395503s) [upload=2989]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:14.500054143 (2h51m14.08939913s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:14.828960068 (2h51m14.418305065s) [upload=2989]: Done uploading segments... Aug 7 12:31:14.828985195 (2h51m14.418330202s) [upload=2989]: Upload finished. err: <nil> Aug 7 12:31:51.421138752 (2h51m51.010483749s) [upload=2999]: Starting upload Aug 7 12:31:51.421215367 (2h51m51.010560354s) [upload=2999]: Done starting upload Aug 7 12:31:51.421278529 (2h51m51.010623536s) [upload=2999]: Uploading segments... Aug 7 12:31:51.421324687 (2h51m51.010669704s) [upload=2999]: Got next segment. Inline: true Aug 7 12:31:51.421329817 (2h51m51.010674804s) [upload=2999]: Waiting for error group managing segments... Aug 7 12:31:51.421373751 (2h51m51.010718748s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:51.421378500 (2h51m51.010723497s) [upload=2999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:51.421382247 (2h51m51.010727254s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:51.741023086 (2h51m51.330368073s) [upload=2999]: Done uploading segments... Aug 7 12:31:51.741042363 (2h51m51.33038734s) [upload=2999]: Upload finished. err: <nil> Aug 7 12:33:06.378431966 (2h53m5.967776943s) [upload=3023]: Starting upload Aug 7 12:33:06.378479197 (2h53m5.967824174s) [upload=3023]: Done starting upload Aug 7 12:33:06.378544331 (2h53m5.967889318s) [upload=3023]: Uploading segments... Aug 7 12:33:06.378635907 (2h53m5.967980884s) [upload=3023]: Got next segment. Inline: true Aug 7 12:33:06.378640135 (2h53m5.967985112s) [upload=3023]: Waiting for error group managing segments... Aug 7 12:33:06.378683327 (2h53m5.968028314s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:06.378688106 (2h53m5.968033093s) [upload=3023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:06.378690431 (2h53m5.968035418s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:06.654130610 (2h53m6.243475597s) [upload=3023]: Done uploading segments... Aug 7 12:33:06.654148996 (2h53m6.243493973s) [upload=3023]: Upload finished. err: <nil> Aug 7 12:33:35.215249854 (2h53m34.804594841s) [upload=3031]: Starting upload Aug 7 12:33:35.215299758 (2h53m34.804644745s) [upload=3031]: Done starting upload Aug 7 12:33:35.215375503 (2h53m34.80472049s) [upload=3031]: Uploading segments... Aug 7 12:33:35.215408707 (2h53m34.804753694s) [upload=3031]: Got next segment. Inline: true Aug 7 12:33:35.215412754 (2h53m34.804757741s) [upload=3031]: Waiting for error group managing segments... Aug 7 12:33:35.215450507 (2h53m34.804795494s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:35.215454535 (2h53m34.804799522s) [upload=3031]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:35.215457069 (2h53m34.804802057s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:35.540448634 (2h53m35.129793621s) [upload=3031]: Done uploading segments... Aug 7 12:33:35.540468722 (2h53m35.129813709s) [upload=3031]: Upload finished. err: <nil> Aug 7 12:34:40.807496878 (2h54m40.396841865s) [upload=3048]: Starting upload Aug 7 12:34:40.807549308 (2h54m40.396894285s) [upload=3048]: Done starting upload Aug 7 12:34:40.807600165 (2h54m40.396945142s) [upload=3048]: Uploading segments... Aug 7 12:34:40.807631215 (2h54m40.396976202s) [upload=3048]: Got next segment. Inline: true Aug 7 12:34:40.807635593 (2h54m40.39698058s) [upload=3048]: Waiting for error group managing segments... Aug 7 12:34:40.807683445 (2h54m40.397028422s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:34:40.807687412 (2h54m40.397032399s) [upload=3048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:34:40.807689797 (2h54m40.397034784s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:34:41.098874490 (2h54m40.688219467s) [upload=3048]: Done uploading segments... Aug 7 12:34:41.098891382 (2h54m40.688236359s) [upload=3048]: Upload finished. err: <nil> Aug 7 12:35:41.631914876 (2h55m41.221259863s) [upload=3067]: Starting upload Aug 7 12:35:41.631989118 (2h55m41.221334115s) [upload=3067]: Done starting upload Aug 7 12:35:41.632049634 (2h55m41.221394621s) [upload=3067]: Uploading segments... Aug 7 12:35:41.632083659 (2h55m41.221428646s) [upload=3067]: Got next segment. Inline: true Aug 7 12:35:41.632088899 (2h55m41.221433886s) [upload=3067]: Waiting for error group managing segments... Aug 7 12:35:41.632123766 (2h55m41.221468743s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:35:41.632127503 (2h55m41.22147249s) [upload=3067]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:35:41.632129787 (2h55m41.221474774s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:35:42.086896186 (2h55m41.676241253s) [upload=3067]: Done uploading segments... Aug 7 12:35:42.086920282 (2h55m41.676265309s) [upload=3067]: Upload finished. err: <nil> Aug 7 12:36:20.993851564 (2h56m20.583196551s) [upload=3079]: Starting upload Aug 7 12:36:20.993913152 (2h56m20.583258139s) [upload=3079]: Done starting upload Aug 7 12:36:20.994018894 (2h56m20.583363882s) [upload=3079]: Uploading segments... Aug 7 12:36:20.994051757 (2h56m20.583396744s) [upload=3079]: Got next segment. Inline: true Aug 7 12:36:20.994066426 (2h56m20.583411413s) [upload=3079]: Waiting for error group managing segments... Aug 7 12:36:20.994102264 (2h56m20.583447241s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:36:20.994106041 (2h56m20.583451028s) [upload=3079]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:36:20.994108245 (2h56m20.583453222s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:36:21.296488949 (2h56m20.885833936s) [upload=3079]: Done uploading segments... Aug 7 12:36:21.296509168 (2h56m20.885854155s) [upload=3079]: Upload finished. err: <nil> Aug 7 12:37:22.483132350 (2h57m22.072477338s) [upload=3092]: Starting upload Aug 7 12:37:22.483185793 (2h57m22.07253077s) [upload=3092]: Done starting upload Aug 7 12:37:22.483245758 (2h57m22.072590745s) [upload=3092]: Uploading segments... Aug 7 12:37:22.483277098 (2h57m22.072622085s) [upload=3092]: Got next segment. Inline: true Aug 7 12:37:22.483281196 (2h57m22.072626183s) [upload=3092]: Waiting for error group managing segments... Aug 7 12:37:22.483316333 (2h57m22.07266132s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Duration:* 1.920798407s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X.........X........................X] duration: 1.362393339s FAIL (2025-08-07 12:38:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== equestItem_SegmentMakeInline Aug 7 12:30:27.647630092 (2h50m27.236975079s) [upload=2977]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:28.008882523 (2h50m27.5982275s) [upload=2977]: Done uploading segments... Aug 7 12:30:28.008902401 (2h50m27.598247388s) [upload=2977]: Upload finished. err: <nil> Aug 7 12:30:55.159551036 (2h50m54.748896023s) [upload=2983]: Starting upload Aug 7 12:30:55.159591593 (2h50m54.74893658s) [upload=2983]: Done starting upload Aug 7 12:30:55.159661457 (2h50m54.749006444s) [upload=2983]: Uploading segments... Aug 7 12:30:55.159694179 (2h50m54.749039166s) [upload=2983]: Got next segment. Inline: true Aug 7 12:30:55.159697997 (2h50m54.749042984s) [upload=2983]: Waiting for error group managing segments... Aug 7 12:30:55.159739876 (2h50m54.749084893s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:30:55.159748543 (2h50m54.749093571s) [upload=2983]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:30:55.159752260 (2h50m54.749097248s) [upload=2983]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:30:55.647163377 (2h50m55.236508364s) [upload=2983]: Done uploading segments... Aug 7 12:30:55.647181432 (2h50m55.236526419s) [upload=2983]: Upload finished. err: <nil> Aug 7 12:31:14.499749821 (2h51m14.089094808s) [upload=2989]: Starting upload Aug 7 12:31:14.499829994 (2h51m14.089174971s) [upload=2989]: Done starting upload Aug 7 12:31:14.499900079 (2h51m14.089245066s) [upload=2989]: Uploading segments... Aug 7 12:31:14.499988067 (2h51m14.089333084s) [upload=2989]: Got next segment. Inline: true Aug 7 12:31:14.499994629 (2h51m14.089339616s) [upload=2989]: Waiting for error group managing segments... Aug 7 12:31:14.500044325 (2h51m14.089389312s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:14.500050466 (2h51m14.089395503s) [upload=2989]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:14.500054143 (2h51m14.08939913s) [upload=2989]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:14.828960068 (2h51m14.418305065s) [upload=2989]: Done uploading segments... Aug 7 12:31:14.828985195 (2h51m14.418330202s) [upload=2989]: Upload finished. err: <nil> Aug 7 12:31:51.421138752 (2h51m51.010483749s) [upload=2999]: Starting upload Aug 7 12:31:51.421215367 (2h51m51.010560354s) [upload=2999]: Done starting upload Aug 7 12:31:51.421278529 (2h51m51.010623536s) [upload=2999]: Uploading segments... Aug 7 12:31:51.421324687 (2h51m51.010669704s) [upload=2999]: Got next segment. Inline: true Aug 7 12:31:51.421329817 (2h51m51.010674804s) [upload=2999]: Waiting for error group managing segments... Aug 7 12:31:51.421373751 (2h51m51.010718748s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:31:51.421378500 (2h51m51.010723497s) [upload=2999]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:31:51.421382247 (2h51m51.010727254s) [upload=2999]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:31:51.741023086 (2h51m51.330368073s) [upload=2999]: Done uploading segments... Aug 7 12:31:51.741042363 (2h51m51.33038734s) [upload=2999]: Upload finished. err: <nil> Aug 7 12:33:06.378431966 (2h53m5.967776943s) [upload=3023]: Starting upload Aug 7 12:33:06.378479197 (2h53m5.967824174s) [upload=3023]: Done starting upload Aug 7 12:33:06.378544331 (2h53m5.967889318s) [upload=3023]: Uploading segments... Aug 7 12:33:06.378635907 (2h53m5.967980884s) [upload=3023]: Got next segment. Inline: true Aug 7 12:33:06.378640135 (2h53m5.967985112s) [upload=3023]: Waiting for error group managing segments... Aug 7 12:33:06.378683327 (2h53m5.968028314s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:06.378688106 (2h53m5.968033093s) [upload=3023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:06.378690431 (2h53m5.968035418s) [upload=3023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:06.654130610 (2h53m6.243475597s) [upload=3023]: Done uploading segments... Aug 7 12:33:06.654148996 (2h53m6.243493973s) [upload=3023]: Upload finished. err: <nil> Aug 7 12:33:35.215249854 (2h53m34.804594841s) [upload=3031]: Starting upload Aug 7 12:33:35.215299758 (2h53m34.804644745s) [upload=3031]: Done starting upload Aug 7 12:33:35.215375503 (2h53m34.80472049s) [upload=3031]: Uploading segments... Aug 7 12:33:35.215408707 (2h53m34.804753694s) [upload=3031]: Got next segment. Inline: true Aug 7 12:33:35.215412754 (2h53m34.804757741s) [upload=3031]: Waiting for error group managing segments... Aug 7 12:33:35.215450507 (2h53m34.804795494s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:33:35.215454535 (2h53m34.804799522s) [upload=3031]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:33:35.215457069 (2h53m34.804802057s) [upload=3031]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:33:35.540448634 (2h53m35.129793621s) [upload=3031]: Done uploading segments... Aug 7 12:33:35.540468722 (2h53m35.129813709s) [upload=3031]: Upload finished. err: <nil> Aug 7 12:34:40.807496878 (2h54m40.396841865s) [upload=3048]: Starting upload Aug 7 12:34:40.807549308 (2h54m40.396894285s) [upload=3048]: Done starting upload Aug 7 12:34:40.807600165 (2h54m40.396945142s) [upload=3048]: Uploading segments... Aug 7 12:34:40.807631215 (2h54m40.396976202s) [upload=3048]: Got next segment. Inline: true Aug 7 12:34:40.807635593 (2h54m40.39698058s) [upload=3048]: Waiting for error group managing segments... Aug 7 12:34:40.807683445 (2h54m40.397028422s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:34:40.807687412 (2h54m40.397032399s) [upload=3048]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:34:40.807689797 (2h54m40.397034784s) [upload=3048]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:34:41.098874490 (2h54m40.688219467s) [upload=3048]: Done uploading segments... Aug 7 12:34:41.098891382 (2h54m40.688236359s) [upload=3048]: Upload finished. err: <nil> Aug 7 12:35:41.631914876 (2h55m41.221259863s) [upload=3067]: Starting upload Aug 7 12:35:41.631989118 (2h55m41.221334115s) [upload=3067]: Done starting upload Aug 7 12:35:41.632049634 (2h55m41.221394621s) [upload=3067]: Uploading segments... Aug 7 12:35:41.632083659 (2h55m41.221428646s) [upload=3067]: Got next segment. Inline: true Aug 7 12:35:41.632088899 (2h55m41.221433886s) [upload=3067]: Waiting for error group managing segments... Aug 7 12:35:41.632123766 (2h55m41.221468743s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:35:41.632127503 (2h55m41.22147249s) [upload=3067]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:35:41.632129787 (2h55m41.221474774s) [upload=3067]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:35:42.086896186 (2h55m41.676241253s) [upload=3067]: Done uploading segments... Aug 7 12:35:42.086920282 (2h55m41.676265309s) [upload=3067]: Upload finished. err: <nil> Aug 7 12:36:20.993851564 (2h56m20.583196551s) [upload=3079]: Starting upload Aug 7 12:36:20.993913152 (2h56m20.583258139s) [upload=3079]: Done starting upload Aug 7 12:36:20.994018894 (2h56m20.583363882s) [upload=3079]: Uploading segments... Aug 7 12:36:20.994051757 (2h56m20.583396744s) [upload=3079]: Got next segment. Inline: true Aug 7 12:36:20.994066426 (2h56m20.583411413s) [upload=3079]: Waiting for error group managing segments... Aug 7 12:36:20.994102264 (2h56m20.583447241s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:36:20.994106041 (2h56m20.583451028s) [upload=3079]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:36:20.994108245 (2h56m20.583453222s) [upload=3079]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:36:21.296488949 (2h56m20.885833936s) [upload=3079]: Done uploading segments... Aug 7 12:36:21.296509168 (2h56m20.885854155s) [upload=3079]: Upload finished. err: <nil> Aug 7 12:37:22.483132350 (2h57m22.072477338s) [upload=3092]: Starting upload Aug 7 12:37:22.483185793 (2h57m22.07253077s) [upload=3092]: Done starting upload Aug 7 12:37:22.483245758 (2h57m22.072590745s) [upload=3092]: Uploading segments... Aug 7 12:37:22.483277098 (2h57m22.072622085s) [upload=3092]: Got next segment. Inline: true Aug 7 12:37:22.483281196 (2h57m22.072626183s) [upload=3092]: Waiting for error group managing segments... Aug 7 12:37:22.483316333 (2h57m22.07266132s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:37:22.483321052 (2h57m22.072666039s) [upload=3092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:37:22.483323616 (2h57m22.072668604s) [upload=3092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:37:22.863570890 (2h57m22.452915878s) [upload=3092]: Done uploading segments... Aug 7 12:37:22.863588463 (2h57m22.452933451s) [upload=3092]: Upload finished. err: <nil> Aug 7 12:38:15.180897993 (2h58m14.77024298s) [upload=3106]: Starting upload Aug 7 12:38:15.180950644 (2h58m14.770295621s) [upload=3106]: Done starting upload Aug 7 12:38:15.181034053 (2h58m14.77037903s) [upload=3106]: Uploading segments... Aug 7 12:38:15.181150978 (2h58m14.770495965s) [upload=3106]: Got next segment. Inline: true Aug 7 12:38:15.181157600 (2h58m14.770502577s) [upload=3106]: Waiting for error group managing segments... Aug 7 12:38:15.181225600 (2h58m14.770570587s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:38:15.181232504 (2h58m14.770577491s) [upload=3106]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:38:15.181236672 (2h58m14.770581669s) [upload=3106]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:38:15.461631501 (2h58m15.050976488s) [upload=3106]: Done uploading segments... Aug 7 12:38:15.461650037 (2h58m15.050995024s) [upload=3106]: Upload finished. err: <nil> Duration:* 1.362416934s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X.........X........................] duration: 1.972236619s FAIL (2025-08-07 12:37:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.972263893s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X.........X.......................] duration: 2.071806803s FAIL (2025-08-07 12:36:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.0718259s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................X.........X......................] duration: 2.197700481s FAIL (2025-08-07 12:35:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.19772532s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................X.........X.....................] duration: 1.885190177s FAIL (2025-08-07 12:34:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.885208793s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................X.........X....................] duration: 1.973775725s FAIL (2025-08-07 12:33:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.973802586s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................X.........X...................] duration: 1.851175928s FAIL (2025-08-07 12:33:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.851199393s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X.........X..................] duration: 1.895932592s FAIL (2025-08-07 12:31:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.895956186s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X.........X.................] duration: 1.929507308s FAIL (2025-08-07 12:31:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.929527886s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.........X................] duration: 2.472105141s FAIL (2025-08-07 12:30:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.472131981s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.........X...............] duration: 1.998262354s FAIL (2025-08-07 12:30:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.99830793s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.........X..............] duration: 1.858269573s FAIL (2025-08-07 12:29:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.85829417s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................................X.........X.............] duration: 1.914855685s FAIL (2025-08-07 12:28:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.914876364s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.........X............] duration: 1.853656173s FAIL (2025-08-07 12:27:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.853700919s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.........X...........] duration: 1.858342608s FAIL (2025-08-07 12:26:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.858375061s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.........X..........] duration: 1.852538938s FAIL (2025-08-07 12:26:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== keInline Aug 7 12:13:11.317522485 (2h33m10.906867472s) [upload=2675]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:11.591160497 (2h33m11.180505484s) [upload=2675]: Done uploading segments... Aug 7 12:13:11.591178821 (2h33m11.180523808s) [upload=2675]: Upload finished. err: <nil> Aug 7 12:13:41.982256263 (2h33m41.57160125s) [upload=2684]: Starting upload Aug 7 12:13:41.982312901 (2h33m41.571657888s) [upload=2684]: Done starting upload Aug 7 12:13:41.982380600 (2h33m41.571725578s) [upload=2684]: Uploading segments... Aug 7 12:13:41.982410558 (2h33m41.571755535s) [upload=2684]: Got next segment. Inline: true Aug 7 12:13:41.982414355 (2h33m41.571759342s) [upload=2684]: Waiting for error group managing segments... Aug 7 12:13:41.982456606 (2h33m41.571801583s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:13:41.982460323 (2h33m41.57180531s) [upload=2684]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:13:41.982462958 (2h33m41.571807945s) [upload=2684]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:13:42.316448451 (2h33m41.905793438s) [upload=2684]: Done uploading segments... Aug 7 12:13:42.316484750 (2h33m41.905829737s) [upload=2684]: Upload finished. err: <nil> Aug 7 12:14:27.416938530 (2h34m27.006283517s) [upload=2697]: Starting upload Aug 7 12:14:27.416985209 (2h34m27.006330186s) [upload=2697]: Done starting upload Aug 7 12:14:27.417038621 (2h34m27.006383608s) [upload=2697]: Uploading segments... Aug 7 12:14:27.417071604 (2h34m27.006416591s) [upload=2697]: Got next segment. Inline: true Aug 7 12:14:27.417075593 (2h34m27.00642058s) [upload=2697]: Waiting for error group managing segments... Aug 7 12:14:27.417107674 (2h34m27.006452661s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:27.417111571 (2h34m27.006456558s) [upload=2697]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:27.417113785 (2h34m27.006458762s) [upload=2697]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:27.712529751 (2h34m27.301874738s) [upload=2697]: Done uploading segments... Aug 7 12:14:27.712548447 (2h34m27.301893434s) [upload=2697]: Upload finished. err: <nil> Aug 7 12:14:52.046663563 (2h34m51.63600855s) [upload=2705]: Starting upload Aug 7 12:14:52.046707037 (2h34m51.636052014s) [upload=2705]: Done starting upload Aug 7 12:14:52.046907530 (2h34m51.636252517s) [upload=2705]: Uploading segments... Aug 7 12:14:52.046960011 (2h34m51.636304988s) [upload=2705]: Got next segment. Inline: true Aug 7 12:14:52.046976773 (2h34m51.63632176s) [upload=2705]: Waiting for error group managing segments... Aug 7 12:14:52.047015928 (2h34m51.636360915s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:14:52.047021709 (2h34m51.636366696s) [upload=2705]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:14:52.047023913 (2h34m51.6363689s) [upload=2705]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:14:52.427197045 (2h34m52.016542092s) [upload=2705]: Done uploading segments... Aug 7 12:14:52.427220089 (2h34m52.016565076s) [upload=2705]: Upload finished. err: <nil> Aug 7 12:15:40.832326180 (2h35m40.421671167s) [upload=2718]: Starting upload Aug 7 12:15:40.832371927 (2h35m40.421716914s) [upload=2718]: Done starting upload Aug 7 12:15:40.832449926 (2h35m40.421794913s) [upload=2718]: Uploading segments... Aug 7 12:15:40.832567562 (2h35m40.421912549s) [upload=2718]: Got next segment. Inline: true Aug 7 12:15:40.832572641 (2h35m40.421917618s) [upload=2718]: Waiting for error group managing segments... Aug 7 12:15:40.832619831 (2h35m40.421964818s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:15:40.832625753 (2h35m40.42197074s) [upload=2718]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:15:40.832628709 (2h35m40.421973696s) [upload=2718]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:15:41.159949940 (2h35m40.749294927s) [upload=2718]: Done uploading segments... Aug 7 12:15:41.159969467 (2h35m40.749314464s) [upload=2718]: Upload finished. err: <nil> Aug 7 12:16:12.558606782 (2h36m12.147951769s) [upload=2727]: Starting upload Aug 7 12:16:12.558657569 (2h36m12.148002556s) [upload=2727]: Done starting upload Aug 7 12:16:12.558712294 (2h36m12.148057281s) [upload=2727]: Uploading segments... Aug 7 12:16:12.558788809 (2h36m12.148133796s) [upload=2727]: Got next segment. Inline: true Aug 7 12:16:12.558793318 (2h36m12.148138305s) [upload=2727]: Waiting for error group managing segments... Aug 7 12:16:12.558829889 (2h36m12.148174876s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:12.558833856 (2h36m12.148178843s) [upload=2727]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:12.558836401 (2h36m12.148181388s) [upload=2727]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:12.845368413 (2h36m12.4347134s) [upload=2727]: Done uploading segments... Aug 7 12:16:12.845389223 (2h36m12.4347342s) [upload=2727]: Upload finished. err: <nil> Aug 7 12:16:28.193778419 (2h36m27.783123406s) [upload=2730]: Starting upload Aug 7 12:16:28.193846841 (2h36m27.783191828s) [upload=2730]: Done starting upload Aug 7 12:16:28.193911424 (2h36m27.783256411s) [upload=2730]: Uploading segments... Aug 7 12:16:28.193946051 (2h36m27.783291038s) [upload=2730]: Got next segment. Inline: true Aug 7 12:16:28.193950078 (2h36m27.783295065s) [upload=2730]: Waiting for error group managing segments... Aug 7 12:16:28.193998620 (2h36m27.783343608s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:28.194002930 (2h36m27.783347917s) [upload=2730]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:28.194005735 (2h36m27.783350722s) [upload=2730]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:28.476261665 (2h36m28.065606652s) [upload=2730]: Done uploading segments... Aug 7 12:16:28.476288386 (2h36m28.065633393s) [upload=2730]: Upload finished. err: <nil> Aug 7 12:16:48.229313899 (2h36m47.818658886s) [upload=2739]: Starting upload Aug 7 12:16:48.229366840 (2h36m47.818711827s) [upload=2739]: Done starting upload Aug 7 12:16:48.229417327 (2h36m47.818762304s) [upload=2739]: Uploading segments... Aug 7 12:16:48.229446482 (2h36m47.818791469s) [upload=2739]: Got next segment. Inline: true Aug 7 12:16:48.229450540 (2h36m47.818795527s) [upload=2739]: Waiting for error group managing segments... Aug 7 12:16:48.229485948 (2h36m47.818830936s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:16:48.229489866 (2h36m47.818834853s) [upload=2739]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:16:48.229492250 (2h36m47.818837227s) [upload=2739]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:16:48.513365526 (2h36m48.102710513s) [upload=2739]: Done uploading segments... Aug 7 12:16:48.513383730 (2h36m48.102728717s) [upload=2739]: Upload finished. err: <nil> Aug 7 12:17:52.179425653 (2h37m51.76877064s) [upload=2756]: Starting upload Aug 7 12:17:52.179519132 (2h37m51.768864119s) [upload=2756]: Done starting upload Aug 7 12:17:52.179571593 (2h37m51.76891661s) [upload=2756]: Uploading segments... Aug 7 12:17:52.179605036 (2h37m51.768950023s) [upload=2756]: Got next segment. Inline: true Aug 7 12:17:52.179608753 (2h37m51.76895374s) [upload=2756]: Waiting for error group managing segments... Aug 7 12:17:52.179644451 (2h37m51.768989438s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:17:52.179648480 (2h37m51.768993467s) [upload=2756]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:17:52.179650914 (2h37m51.768995901s) [upload=2756]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:17:52.534478653 (2h37m52.12382363s) [upload=2756]: Done uploading segments... Aug 7 12:17:52.534493310 (2h37m52.123838297s) [upload=2756]: Upload finished. err: <nil> Aug 7 12:18:09.499452972 (2h38m9.088797949s) [upload=2762]: Starting upload Aug 7 12:18:09.499528506 (2h38m9.088873493s) [upload=2762]: Done starting upload Aug 7 12:18:09.499587800 (2h38m9.088932787s) [upload=2762]: Uploading segments... Aug 7 12:18:09.499619700 (2h38m9.088964687s) [upload=2762]: Got next segment. Inline: true Aug 7 12:18:09.499623508 (2h38m9.088968495s) [upload=2762]: Waiting for error group managing segments... Aug 7 12:18:09.499654727 (2h38m9.088999714s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:09.499658444 (2h38m9.089003431s) [upload=2762]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:09.499660709 (2h38m9.089005696s) [upload=2762]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:09.864969942 (2h38m9.454314929s) [upload=2762]: Done uploading segments... Aug 7 12:18:09.864987755 (2h38m9.454332742s) [upload=2762]: Upload finished. err: <nil> Aug 7 12:18:42.437345297 (2h38m42.026690285s) [upload=2773]: Starting upload Aug 7 12:18:42.437393620 (2h38m42.026738597s) [upload=2773]: Done starting upload Aug 7 12:18:42.437446101 (2h38m42.026791088s) [upload=2773]: Uploading segments... Aug 7 12:18:42.437478072 (2h38m42.026823059s) [upload=2773]: Got next segment. Inline: true Aug 7 12:18:42.437483512 (2h38m42.026828499s) [upload=2773]: Waiting for error group managing segments... Aug 7 12:18:42.437514521 (2h38m42.026859508s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 12:18:42.437518278 (2h38m42.026863265s) [upload=2773]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 12:18:42.437520512 (2h38m42.026865499s) [upload=2773]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 12:18:42.650164638 (2h38m42.239509625s) [upload=2773]: Done uploading segments... Aug 7 12:18:42.650181309 (2h38m42.239526296s) [upload=2773]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.852563424s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)