Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X........X.............................................] duration: 1.984532723s FAIL (2025-08-07 20:09:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.984566779s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.................X..] duration: 6.256008755s FAIL (2025-08-07 20:09:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== : Upload finished. err: <nil> Aug 7 20:07:51.514722461 (10h27m51.104067438s) [upload=10913]: Starting upload Aug 7 20:07:51.514770953 (10h27m51.10411593s) [upload=10913]: Done starting upload Aug 7 20:07:51.514906633 (10h27m51.10425162s) [upload=10913]: Uploading segments... Aug 7 20:07:51.515029608 (10h27m51.104374595s) [upload=10913]: Got next segment. Inline: false Aug 7 20:07:51.515065898 (10h27m51.104410875s) [upload=10913]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 20:07:51.515070787 (10h27m51.104415774s) [upload=10913]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 20:07:51.964944226 (10h27m51.554289213s) [seg_pos={0 0}, upload=10913]: Begin upload segment... Aug 7 20:07:51.964993621 (10h27m51.554338608s) [seg_pos={0 0}, upload=10913]: Done begin upload segment. Aug 7 20:07:51.965603127 (10h27m51.554948114s) [noise=true , address=64.49.13.169:4708 , piece_id=NZ6EYBRMATTU3EMOT7TFMB4SWMQKGU6ON5SV5ZUUDZ6W5F3D47AA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.965672780 (10h27m51.555017767s) [noise=true , address=104.36.82.61:4390 , piece_id=H7U7ILVYVYQRXDXOWAMYIWVKJVI34QSQ7SRKDEEXRWLMQJKTXFEQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966339275 (10h27m51.555684262s) [noise=true , address=104.36.82.41:4777 , piece_id=C7BLPPMO2ZCGQOA2V6IN5IH4JHAKJIOCRIWQASDV6ZQRPAN2GN3A, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966372599 (10h27m51.555717586s) [noise=true , address=104.36.82.43:4840 , piece_id=MMZ7N2AT3NHVFKQZTT5RHMIHJPS3YQUC3KIIHTX7LR4N77HMWTWA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966873307 (10h27m51.556218294s) [noise=true , address=104.36.82.56:4244 , piece_id=HV2KMQJWZSMVGJF4FTEKBWB7OWLRTYHKG3BP73TNCI7IEDVWYLAQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966940094 (10h27m51.556285071s) [noise=true , address=104.36.82.59:4325 , piece_id=AUZ2UYDG3MRGHY3CKOGJ7AKRTXZQ7NEJS5POK7C3ILS3DBP6WGRA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.967355359 (10h27m51.556700356s) [noise=true , address=104.36.82.34:4556 , piece_id=2D5PV5Q24WKABKQAF57I4BWA4GNEENXEYV7T4Y4U7LJPEPCR53VQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.967802074 (10h27m51.557147061s) [noise=true , address=45.91.116.9:4294 , piece_id=J4FHNW7MZ2MUEO2YL5VDKWHUC5AI2VRNK4Q7WWMOO6JH2KHNMETA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968031333 (10h27m51.55737632s) [noise=true , address=104.36.82.58:4291 , piece_id=L6N53EEJYEVYEQEDZYPQ22PRGX7SATJ6UQINUQT4XZFN4XLSDDFQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968309064 (10h27m51.557654051s) [noise=true , address=104.36.82.16:4307 , piece_id=ZQSPAVDEWY2PGE44Z4TB3L353KEYKF5FNNNGHQ3TNMFSW2I7V3GA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968540546 (10h27m51.557885533s) [noise=true , address=104.36.82.23:4469 , piece_id=T73MB4S5GTSDRQLMBRXXVRC6XOQMFXHN5CJXL3EQI2IYAZZ55YPQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968584621 (10h27m51.557929608s) [noise=true , address=104.36.82.38:4699 , piece_id=5SHQTJ5EY3MHBWLH7P2MFK2D55AZGV5FHGOS7BT2UKENMLZC4FGQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968883253 (10h27m51.55822824s) [noise=true , address=104.36.82.37:4664 , piece_id=RTAWLCG67K2ISZZCREB24DOC4ECGW2LVJGBLOPAG6TOR47VLZO2A, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.969038450 (10h27m51.558383427s) [noise=true , address=104.36.82.39:4735 , piece_id=6O7AKFJU3RGZ72L5AV4Y557IKSDUPGS27MAJA3VJK6HL7THJY7YA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.969373120 (10h27m51.558718107s) [noise=true , address=104.36.82.9:4022 , piece_id=PWDPTSMHPXNEYKRZQYO4JBZLM22X37YAK34NZKA6GSP6FGDZ4B4A, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.969727859 (10h27m51.559072846s) [noise=true , address=104.36.82.3:4773 , piece_id=M35KPUOPSRI4MATP75OFERBBG3G6L2JENVVRKEGHXVKWX3WWUKNA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.970007935 (10h27m51.559352922s) [noise=true , address=104.36.82.36:4633 , piece_id=K4OF7SGEF64WBK5AVWUJSJG75ABAIZDJ5NBAAGH4JUDM5ZOYJ6YQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.970799269 (10h27m51.560144256s) [noise=true , address=104.36.82.53:4124 , piece_id=PH64KT4RL6NISYA4SFSEVKUEIU5P3KB2UFGEYCW2HSMYIAPHMOBA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:53.103777621 (10h27m52.693122608s) [upload=10913]: Next returned nil segment Aug 7 20:07:53.103790917 (10h27m52.693135904s) [upload=10913]: Waiting for error group managing segments... Aug 7 20:07:53.394548044 (10h27m52.983893031s) [noise=true , address=64.49.13.169:4708 , piece_id=NZ6EYBRMATTU3EMOT7TFMB4SWMQKGU6ON5SV5ZUUDZ6W5F3D47AA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.902386936 (10h27m53.491731923s) [noise=true , address=104.36.82.36:4633 , piece_id=K4OF7SGEF64WBK5AVWUJSJG75ABAIZDJ5NBAAGH4JUDM5ZOYJ6YQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.910257505 (10h27m53.499602492s) [noise=true , address=104.36.82.41:4777 , piece_id=C7BLPPMO2ZCGQOA2V6IN5IH4JHAKJIOCRIWQASDV6ZQRPAN2GN3A, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.919608195 (10h27m53.508953182s) [noise=true , address=104.36.82.34:4556 , piece_id=2D5PV5Q24WKABKQAF57I4BWA4GNEENXEYV7T4Y4U7LJPEPCR53VQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.934660014 (10h27m53.524005001s) [noise=true , address=104.36.82.58:4291 , piece_id=L6N53EEJYEVYEQEDZYPQ22PRGX7SATJ6UQINUQT4XZFN4XLSDDFQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.994726117 (10h27m53.584071094s) [noise=true , address=104.36.82.37:4664 , piece_id=RTAWLCG67K2ISZZCREB24DOC4ECGW2LVJGBLOPAG6TOR47VLZO2A, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.994896442 (10h27m53.584241429s) [noise=true , address=104.36.82.61:4390 , piece_id=H7U7ILVYVYQRXDXOWAMYIWVKJVI34QSQ7SRKDEEXRWLMQJKTXFEQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.006301533 (10h27m53.59564652s) [noise=true , address=104.36.82.3:4773 , piece_id=M35KPUOPSRI4MATP75OFERBBG3G6L2JENVVRKEGHXVKWX3WWUKNA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.033329805 (10h27m53.622674792s) [noise=true , address=104.36.82.56:4244 , piece_id=HV2KMQJWZSMVGJF4FTEKBWB7OWLRTYHKG3BP73TNCI7IEDVWYLAQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.052354053 (10h27m53.64169903s) [noise=true , address=104.36.82.39:4735 , piece_id=6O7AKFJU3RGZ72L5AV4Y557IKSDUPGS27MAJA3VJK6HL7THJY7YA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.052585477 (10h27m53.641930464s) [noise=true , address=104.36.82.38:4699 , piece_id=5SHQTJ5EY3MHBWLH7P2MFK2D55AZGV5FHGOS7BT2UKENMLZC4FGQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.060259840 (10h27m53.649604827s) [noise=true , address=104.36.82.53:4124 , piece_id=PH64KT4RL6NISYA4SFSEVKUEIU5P3KB2UFGEYCW2HSMYIAPHMOBA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.104654038 (10h27m53.693999025s) [noise=true , address=104.36.82.59:4325 , piece_id=AUZ2UYDG3MRGHY3CKOGJ7AKRTXZQ7NEJS5POK7C3ILS3DBP6WGRA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.120232604 (10h27m53.709577591s) [noise=true , address=104.36.82.23:4469 , piece_id=T73MB4S5GTSDRQLMBRXXVRC6XOQMFXHN5CJXL3EQI2IYAZZ55YPQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.120258093 (10h27m53.70960307s) [seg_pos={0 0}, upload=10913]: Segment reached optimal threshold of 14 pieces. Aug 7 20:07:54.120369516 (10h27m53.709714493s) [noise=true , address=45.91.116.9:4294 , piece_id=J4FHNW7MZ2MUEO2YL5VDKWHUC5AI2VRNK4Q7WWMOO6JH2KHNMETA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d7KuNgPYL5Ca2MPKQQCueQNSsYQifHXMhQ87VEXUhrKpLjuks): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120425573 (10h27m53.70977056s) [noise=true , address=104.36.82.16:4307 , piece_id=ZQSPAVDEWY2PGE44Z4TB3L353KEYKF5FNNNGHQ3TNMFSW2I7V3GA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QGfzeTEErAaE5YRTLi1w7SZoJbo2xVKb1Sykj1pW5fbCZYSCn): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120451543 (10h27m53.70979653s) [noise=true , address=104.36.82.43:4840 , piece_id=MMZ7N2AT3NHVFKQZTT5RHMIHJPS3YQUC3KIIHTX7LR4N77HMWTWA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1e73S8evH6nTk9V3fHL24n5BQtzdQydvqugcHEiYHZgVDbkTjL): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120480408 (10h27m53.709825395s) [noise=true , address=104.36.82.9:4022 , piece_id=PWDPTSMHPXNEYKRZQYO4JBZLM22X37YAK34NZKA6GSP6FGDZ4B4A, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120494325 (10h27m53.709839302s) [seg_pos={0 0}, upload=10913]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 20:07:54.120551264 (10h27m53.709896241s) [upload=10913]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 20:07:54.120554931 (10h27m53.709899918s) [upload=10913]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 20:07:54.548216342 (10h27m54.137561329s) [upload=10913]: Done uploading segments... Aug 7 20:07:54.548235108 (10h27m54.137580115s) [upload=10913]: Upload finished. err: <nil> Duration: 6.256051037s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X........X............................................] duration: 1.896787263s FAIL (2025-08-07 20:08:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.896817552s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.................X.] duration: 5.945548186s FAIL (2025-08-07 20:08:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== : Upload finished. err: <nil> Aug 7 20:07:51.514722461 (10h27m51.104067438s) [upload=10913]: Starting upload Aug 7 20:07:51.514770953 (10h27m51.10411593s) [upload=10913]: Done starting upload Aug 7 20:07:51.514906633 (10h27m51.10425162s) [upload=10913]: Uploading segments... Aug 7 20:07:51.515029608 (10h27m51.104374595s) [upload=10913]: Got next segment. Inline: false Aug 7 20:07:51.515065898 (10h27m51.104410875s) [upload=10913]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 20:07:51.515070787 (10h27m51.104415774s) [upload=10913]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 20:07:51.964944226 (10h27m51.554289213s) [seg_pos={0 0}, upload=10913]: Begin upload segment... Aug 7 20:07:51.964993621 (10h27m51.554338608s) [seg_pos={0 0}, upload=10913]: Done begin upload segment. Aug 7 20:07:51.965603127 (10h27m51.554948114s) [noise=true , address=64.49.13.169:4708 , piece_id=NZ6EYBRMATTU3EMOT7TFMB4SWMQKGU6ON5SV5ZUUDZ6W5F3D47AA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.965672780 (10h27m51.555017767s) [noise=true , address=104.36.82.61:4390 , piece_id=H7U7ILVYVYQRXDXOWAMYIWVKJVI34QSQ7SRKDEEXRWLMQJKTXFEQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966339275 (10h27m51.555684262s) [noise=true , address=104.36.82.41:4777 , piece_id=C7BLPPMO2ZCGQOA2V6IN5IH4JHAKJIOCRIWQASDV6ZQRPAN2GN3A, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966372599 (10h27m51.555717586s) [noise=true , address=104.36.82.43:4840 , piece_id=MMZ7N2AT3NHVFKQZTT5RHMIHJPS3YQUC3KIIHTX7LR4N77HMWTWA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966873307 (10h27m51.556218294s) [noise=true , address=104.36.82.56:4244 , piece_id=HV2KMQJWZSMVGJF4FTEKBWB7OWLRTYHKG3BP73TNCI7IEDVWYLAQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966940094 (10h27m51.556285071s) [noise=true , address=104.36.82.59:4325 , piece_id=AUZ2UYDG3MRGHY3CKOGJ7AKRTXZQ7NEJS5POK7C3ILS3DBP6WGRA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.967355359 (10h27m51.556700356s) [noise=true , address=104.36.82.34:4556 , piece_id=2D5PV5Q24WKABKQAF57I4BWA4GNEENXEYV7T4Y4U7LJPEPCR53VQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.967802074 (10h27m51.557147061s) [noise=true , address=45.91.116.9:4294 , piece_id=J4FHNW7MZ2MUEO2YL5VDKWHUC5AI2VRNK4Q7WWMOO6JH2KHNMETA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968031333 (10h27m51.55737632s) [noise=true , address=104.36.82.58:4291 , piece_id=L6N53EEJYEVYEQEDZYPQ22PRGX7SATJ6UQINUQT4XZFN4XLSDDFQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968309064 (10h27m51.557654051s) [noise=true , address=104.36.82.16:4307 , piece_id=ZQSPAVDEWY2PGE44Z4TB3L353KEYKF5FNNNGHQ3TNMFSW2I7V3GA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968540546 (10h27m51.557885533s) [noise=true , address=104.36.82.23:4469 , piece_id=T73MB4S5GTSDRQLMBRXXVRC6XOQMFXHN5CJXL3EQI2IYAZZ55YPQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968584621 (10h27m51.557929608s) [noise=true , address=104.36.82.38:4699 , piece_id=5SHQTJ5EY3MHBWLH7P2MFK2D55AZGV5FHGOS7BT2UKENMLZC4FGQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968883253 (10h27m51.55822824s) [noise=true , address=104.36.82.37:4664 , piece_id=RTAWLCG67K2ISZZCREB24DOC4ECGW2LVJGBLOPAG6TOR47VLZO2A, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.969038450 (10h27m51.558383427s) [noise=true , address=104.36.82.39:4735 , piece_id=6O7AKFJU3RGZ72L5AV4Y557IKSDUPGS27MAJA3VJK6HL7THJY7YA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.969373120 (10h27m51.558718107s) [noise=true , address=104.36.82.9:4022 , piece_id=PWDPTSMHPXNEYKRZQYO4JBZLM22X37YAK34NZKA6GSP6FGDZ4B4A, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.969727859 (10h27m51.559072846s) [noise=true , address=104.36.82.3:4773 , piece_id=M35KPUOPSRI4MATP75OFERBBG3G6L2JENVVRKEGHXVKWX3WWUKNA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.970007935 (10h27m51.559352922s) [noise=true , address=104.36.82.36:4633 , piece_id=K4OF7SGEF64WBK5AVWUJSJG75ABAIZDJ5NBAAGH4JUDM5ZOYJ6YQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.970799269 (10h27m51.560144256s) [noise=true , address=104.36.82.53:4124 , piece_id=PH64KT4RL6NISYA4SFSEVKUEIU5P3KB2UFGEYCW2HSMYIAPHMOBA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:53.103777621 (10h27m52.693122608s) [upload=10913]: Next returned nil segment Aug 7 20:07:53.103790917 (10h27m52.693135904s) [upload=10913]: Waiting for error group managing segments... Aug 7 20:07:53.394548044 (10h27m52.983893031s) [noise=true , address=64.49.13.169:4708 , piece_id=NZ6EYBRMATTU3EMOT7TFMB4SWMQKGU6ON5SV5ZUUDZ6W5F3D47AA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.902386936 (10h27m53.491731923s) [noise=true , address=104.36.82.36:4633 , piece_id=K4OF7SGEF64WBK5AVWUJSJG75ABAIZDJ5NBAAGH4JUDM5ZOYJ6YQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.910257505 (10h27m53.499602492s) [noise=true , address=104.36.82.41:4777 , piece_id=C7BLPPMO2ZCGQOA2V6IN5IH4JHAKJIOCRIWQASDV6ZQRPAN2GN3A, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.919608195 (10h27m53.508953182s) [noise=true , address=104.36.82.34:4556 , piece_id=2D5PV5Q24WKABKQAF57I4BWA4GNEENXEYV7T4Y4U7LJPEPCR53VQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.934660014 (10h27m53.524005001s) [noise=true , address=104.36.82.58:4291 , piece_id=L6N53EEJYEVYEQEDZYPQ22PRGX7SATJ6UQINUQT4XZFN4XLSDDFQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.994726117 (10h27m53.584071094s) [noise=true , address=104.36.82.37:4664 , piece_id=RTAWLCG67K2ISZZCREB24DOC4ECGW2LVJGBLOPAG6TOR47VLZO2A, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.994896442 (10h27m53.584241429s) [noise=true , address=104.36.82.61:4390 , piece_id=H7U7ILVYVYQRXDXOWAMYIWVKJVI34QSQ7SRKDEEXRWLMQJKTXFEQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.006301533 (10h27m53.59564652s) [noise=true , address=104.36.82.3:4773 , piece_id=M35KPUOPSRI4MATP75OFERBBG3G6L2JENVVRKEGHXVKWX3WWUKNA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.033329805 (10h27m53.622674792s) [noise=true , address=104.36.82.56:4244 , piece_id=HV2KMQJWZSMVGJF4FTEKBWB7OWLRTYHKG3BP73TNCI7IEDVWYLAQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.052354053 (10h27m53.64169903s) [noise=true , address=104.36.82.39:4735 , piece_id=6O7AKFJU3RGZ72L5AV4Y557IKSDUPGS27MAJA3VJK6HL7THJY7YA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.052585477 (10h27m53.641930464s) [noise=true , address=104.36.82.38:4699 , piece_id=5SHQTJ5EY3MHBWLH7P2MFK2D55AZGV5FHGOS7BT2UKENMLZC4FGQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.060259840 (10h27m53.649604827s) [noise=true , address=104.36.82.53:4124 , piece_id=PH64KT4RL6NISYA4SFSEVKUEIU5P3KB2UFGEYCW2HSMYIAPHMOBA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.104654038 (10h27m53.693999025s) [noise=true , address=104.36.82.59:4325 , piece_id=AUZ2UYDG3MRGHY3CKOGJ7AKRTXZQ7NEJS5POK7C3ILS3DBP6WGRA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.120232604 (10h27m53.709577591s) [noise=true , address=104.36.82.23:4469 , piece_id=T73MB4S5GTSDRQLMBRXXVRC6XOQMFXHN5CJXL3EQI2IYAZZ55YPQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.120258093 (10h27m53.70960307s) [seg_pos={0 0}, upload=10913]: Segment reached optimal threshold of 14 pieces. Aug 7 20:07:54.120369516 (10h27m53.709714493s) [noise=true , address=45.91.116.9:4294 , piece_id=J4FHNW7MZ2MUEO2YL5VDKWHUC5AI2VRNK4Q7WWMOO6JH2KHNMETA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d7KuNgPYL5Ca2MPKQQCueQNSsYQifHXMhQ87VEXUhrKpLjuks): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120425573 (10h27m53.70977056s) [noise=true , address=104.36.82.16:4307 , piece_id=ZQSPAVDEWY2PGE44Z4TB3L353KEYKF5FNNNGHQ3TNMFSW2I7V3GA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QGfzeTEErAaE5YRTLi1w7SZoJbo2xVKb1Sykj1pW5fbCZYSCn): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120451543 (10h27m53.70979653s) [noise=true , address=104.36.82.43:4840 , piece_id=MMZ7N2AT3NHVFKQZTT5RHMIHJPS3YQUC3KIIHTX7LR4N77HMWTWA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1e73S8evH6nTk9V3fHL24n5BQtzdQydvqugcHEiYHZgVDbkTjL): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120480408 (10h27m53.709825395s) [noise=true , address=104.36.82.9:4022 , piece_id=PWDPTSMHPXNEYKRZQYO4JBZLM22X37YAK34NZKA6GSP6FGDZ4B4A, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120494325 (10h27m53.709839302s) [seg_pos={0 0}, upload=10913]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 20:07:54.120551264 (10h27m53.709896241s) [upload=10913]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 20:07:54.120554931 (10h27m53.709899918s) [upload=10913]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 20:07:54.548216342 (10h27m54.137561329s) [upload=10913]: Done uploading segments... Aug 7 20:07:54.548235108 (10h27m54.137580115s) [upload=10913]: Upload finished. err: <nil> Duration: 5.945578756s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.................X] duration: 4.131862204s FAIL (2025-08-07 20:07:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== : Upload finished. err: <nil> Aug 7 20:07:51.514722461 (10h27m51.104067438s) [upload=10913]: Starting upload Aug 7 20:07:51.514770953 (10h27m51.10411593s) [upload=10913]: Done starting upload Aug 7 20:07:51.514906633 (10h27m51.10425162s) [upload=10913]: Uploading segments... Aug 7 20:07:51.515029608 (10h27m51.104374595s) [upload=10913]: Got next segment. Inline: false Aug 7 20:07:51.515065898 (10h27m51.104410875s) [upload=10913]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 20:07:51.515070787 (10h27m51.104415774s) [upload=10913]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 20:07:51.964944226 (10h27m51.554289213s) [seg_pos={0 0}, upload=10913]: Begin upload segment... Aug 7 20:07:51.964993621 (10h27m51.554338608s) [seg_pos={0 0}, upload=10913]: Done begin upload segment. Aug 7 20:07:51.965603127 (10h27m51.554948114s) [noise=true , address=64.49.13.169:4708 , piece_id=NZ6EYBRMATTU3EMOT7TFMB4SWMQKGU6ON5SV5ZUUDZ6W5F3D47AA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.965672780 (10h27m51.555017767s) [noise=true , address=104.36.82.61:4390 , piece_id=H7U7ILVYVYQRXDXOWAMYIWVKJVI34QSQ7SRKDEEXRWLMQJKTXFEQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966339275 (10h27m51.555684262s) [noise=true , address=104.36.82.41:4777 , piece_id=C7BLPPMO2ZCGQOA2V6IN5IH4JHAKJIOCRIWQASDV6ZQRPAN2GN3A, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966372599 (10h27m51.555717586s) [noise=true , address=104.36.82.43:4840 , piece_id=MMZ7N2AT3NHVFKQZTT5RHMIHJPS3YQUC3KIIHTX7LR4N77HMWTWA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966873307 (10h27m51.556218294s) [noise=true , address=104.36.82.56:4244 , piece_id=HV2KMQJWZSMVGJF4FTEKBWB7OWLRTYHKG3BP73TNCI7IEDVWYLAQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.966940094 (10h27m51.556285071s) [noise=true , address=104.36.82.59:4325 , piece_id=AUZ2UYDG3MRGHY3CKOGJ7AKRTXZQ7NEJS5POK7C3ILS3DBP6WGRA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.967355359 (10h27m51.556700356s) [noise=true , address=104.36.82.34:4556 , piece_id=2D5PV5Q24WKABKQAF57I4BWA4GNEENXEYV7T4Y4U7LJPEPCR53VQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.967802074 (10h27m51.557147061s) [noise=true , address=45.91.116.9:4294 , piece_id=J4FHNW7MZ2MUEO2YL5VDKWHUC5AI2VRNK4Q7WWMOO6JH2KHNMETA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968031333 (10h27m51.55737632s) [noise=true , address=104.36.82.58:4291 , piece_id=L6N53EEJYEVYEQEDZYPQ22PRGX7SATJ6UQINUQT4XZFN4XLSDDFQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968309064 (10h27m51.557654051s) [noise=true , address=104.36.82.16:4307 , piece_id=ZQSPAVDEWY2PGE44Z4TB3L353KEYKF5FNNNGHQ3TNMFSW2I7V3GA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968540546 (10h27m51.557885533s) [noise=true , address=104.36.82.23:4469 , piece_id=T73MB4S5GTSDRQLMBRXXVRC6XOQMFXHN5CJXL3EQI2IYAZZ55YPQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968584621 (10h27m51.557929608s) [noise=true , address=104.36.82.38:4699 , piece_id=5SHQTJ5EY3MHBWLH7P2MFK2D55AZGV5FHGOS7BT2UKENMLZC4FGQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.968883253 (10h27m51.55822824s) [noise=true , address=104.36.82.37:4664 , piece_id=RTAWLCG67K2ISZZCREB24DOC4ECGW2LVJGBLOPAG6TOR47VLZO2A, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.969038450 (10h27m51.558383427s) [noise=true , address=104.36.82.39:4735 , piece_id=6O7AKFJU3RGZ72L5AV4Y557IKSDUPGS27MAJA3VJK6HL7THJY7YA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.969373120 (10h27m51.558718107s) [noise=true , address=104.36.82.9:4022 , piece_id=PWDPTSMHPXNEYKRZQYO4JBZLM22X37YAK34NZKA6GSP6FGDZ4B4A, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.969727859 (10h27m51.559072846s) [noise=true , address=104.36.82.3:4773 , piece_id=M35KPUOPSRI4MATP75OFERBBG3G6L2JENVVRKEGHXVKWX3WWUKNA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.970007935 (10h27m51.559352922s) [noise=true , address=104.36.82.36:4633 , piece_id=K4OF7SGEF64WBK5AVWUJSJG75ABAIZDJ5NBAAGH4JUDM5ZOYJ6YQ, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:51.970799269 (10h27m51.560144256s) [noise=true , address=104.36.82.53:4124 , piece_id=PH64KT4RL6NISYA4SFSEVKUEIU5P3KB2UFGEYCW2HSMYIAPHMOBA, seg_pos={0 0}, upload=10913]: Uploading piece... Aug 7 20:07:53.103777621 (10h27m52.693122608s) [upload=10913]: Next returned nil segment Aug 7 20:07:53.103790917 (10h27m52.693135904s) [upload=10913]: Waiting for error group managing segments... Aug 7 20:07:53.394548044 (10h27m52.983893031s) [noise=true , address=64.49.13.169:4708 , piece_id=NZ6EYBRMATTU3EMOT7TFMB4SWMQKGU6ON5SV5ZUUDZ6W5F3D47AA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.902386936 (10h27m53.491731923s) [noise=true , address=104.36.82.36:4633 , piece_id=K4OF7SGEF64WBK5AVWUJSJG75ABAIZDJ5NBAAGH4JUDM5ZOYJ6YQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.910257505 (10h27m53.499602492s) [noise=true , address=104.36.82.41:4777 , piece_id=C7BLPPMO2ZCGQOA2V6IN5IH4JHAKJIOCRIWQASDV6ZQRPAN2GN3A, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.919608195 (10h27m53.508953182s) [noise=true , address=104.36.82.34:4556 , piece_id=2D5PV5Q24WKABKQAF57I4BWA4GNEENXEYV7T4Y4U7LJPEPCR53VQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.934660014 (10h27m53.524005001s) [noise=true , address=104.36.82.58:4291 , piece_id=L6N53EEJYEVYEQEDZYPQ22PRGX7SATJ6UQINUQT4XZFN4XLSDDFQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.994726117 (10h27m53.584071094s) [noise=true , address=104.36.82.37:4664 , piece_id=RTAWLCG67K2ISZZCREB24DOC4ECGW2LVJGBLOPAG6TOR47VLZO2A, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:53.994896442 (10h27m53.584241429s) [noise=true , address=104.36.82.61:4390 , piece_id=H7U7ILVYVYQRXDXOWAMYIWVKJVI34QSQ7SRKDEEXRWLMQJKTXFEQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.006301533 (10h27m53.59564652s) [noise=true , address=104.36.82.3:4773 , piece_id=M35KPUOPSRI4MATP75OFERBBG3G6L2JENVVRKEGHXVKWX3WWUKNA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.033329805 (10h27m53.622674792s) [noise=true , address=104.36.82.56:4244 , piece_id=HV2KMQJWZSMVGJF4FTEKBWB7OWLRTYHKG3BP73TNCI7IEDVWYLAQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.052354053 (10h27m53.64169903s) [noise=true , address=104.36.82.39:4735 , piece_id=6O7AKFJU3RGZ72L5AV4Y557IKSDUPGS27MAJA3VJK6HL7THJY7YA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.052585477 (10h27m53.641930464s) [noise=true , address=104.36.82.38:4699 , piece_id=5SHQTJ5EY3MHBWLH7P2MFK2D55AZGV5FHGOS7BT2UKENMLZC4FGQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.060259840 (10h27m53.649604827s) [noise=true , address=104.36.82.53:4124 , piece_id=PH64KT4RL6NISYA4SFSEVKUEIU5P3KB2UFGEYCW2HSMYIAPHMOBA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.104654038 (10h27m53.693999025s) [noise=true , address=104.36.82.59:4325 , piece_id=AUZ2UYDG3MRGHY3CKOGJ7AKRTXZQ7NEJS5POK7C3ILS3DBP6WGRA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.120232604 (10h27m53.709577591s) [noise=true , address=104.36.82.23:4469 , piece_id=T73MB4S5GTSDRQLMBRXXVRC6XOQMFXHN5CJXL3EQI2IYAZZ55YPQ, seg_pos={0 0}, upload=10913]: Done uploading piece. err: <nil> Aug 7 20:07:54.120258093 (10h27m53.70960307s) [seg_pos={0 0}, upload=10913]: Segment reached optimal threshold of 14 pieces. Aug 7 20:07:54.120369516 (10h27m53.709714493s) [noise=true , address=45.91.116.9:4294 , piece_id=J4FHNW7MZ2MUEO2YL5VDKWHUC5AI2VRNK4Q7WWMOO6JH2KHNMETA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12d7KuNgPYL5Ca2MPKQQCueQNSsYQifHXMhQ87VEXUhrKpLjuks): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120425573 (10h27m53.70977056s) [noise=true , address=104.36.82.16:4307 , piece_id=ZQSPAVDEWY2PGE44Z4TB3L353KEYKF5FNNNGHQ3TNMFSW2I7V3GA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QGfzeTEErAaE5YRTLi1w7SZoJbo2xVKb1Sykj1pW5fbCZYSCn): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120451543 (10h27m53.70979653s) [noise=true , address=104.36.82.43:4840 , piece_id=MMZ7N2AT3NHVFKQZTT5RHMIHJPS3YQUC3KIIHTX7LR4N77HMWTWA, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1e73S8evH6nTk9V3fHL24n5BQtzdQydvqugcHEiYHZgVDbkTjL): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120480408 (10h27m53.709825395s) [noise=true , address=104.36.82.9:4022 , piece_id=PWDPTSMHPXNEYKRZQYO4JBZLM22X37YAK34NZKA6GSP6FGDZ4B4A, seg_pos={0 0}, upload=10913]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XGBWwhqJ324UTpv3b1bNsGVUjJSLptvqV6dHrYJsto8KbDvYU): protocol: expected piece hash; context canceled; EOF Aug 7 20:07:54.120494325 (10h27m53.709839302s) [seg_pos={0 0}, upload=10913]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 20:07:54.120551264 (10h27m53.709896241s) [upload=10913]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 20:07:54.120554931 (10h27m53.709899918s) [upload=10913]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 20:07:54.548216342 (10h27m54.137561329s) [upload=10913]: Done uploading segments... Aug 7 20:07:54.548235108 (10h27m54.137580115s) [upload=10913]: Upload finished. err: <nil> Duration: 4.131888466s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X........X...........................................] duration: 1.873930063s FAIL (2025-08-07 20:07:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.873965612s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.868652288s FAIL (2025-08-07 20:07:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 5.868671814s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X........X..........................................] duration: 1.935119374s FAIL (2025-08-07 20:07:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.935146396s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.060418433s FAIL (2025-08-07 20:06:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 6.060443591s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X........X.........................................] duration: 1.900361644s FAIL (2025-08-07 20:06:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.900397292s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.466659311s FAIL (2025-08-07 20:06:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 6.466690551s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.38779458s FAIL (2025-08-07 20:05:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 6.387821371s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X........X........................................] duration: 2.009577031s FAIL (2025-08-07 20:05:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 2.009602019s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X........X.......................................] duration: 1.824150792s FAIL (2025-08-07 20:04:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.824170048s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.904502152s FAIL (2025-08-07 20:04:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 5.904539894s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.40610352s FAIL (2025-08-07 20:04:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 6.406140462s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X........X......................................] duration: 1.85779373s FAIL (2025-08-07 20:03:54 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.857822875s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.991608519s FAIL (2025-08-07 20:02:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 5.991634278s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X........X.....................................] duration: 1.8564027s FAIL (2025-08-07 20:02:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.856436182s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.086432941s FAIL (2025-08-07 20:01:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 6.086460133s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X........X....................................] duration: 1.848998833s FAIL (2025-08-07 20:01:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.849022139s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X........X...................................] duration: 1.848595399s FAIL (2025-08-07 20:01:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.848624606s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.142258614s FAIL (2025-08-07 20:00:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 6.142280225s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.172648738s FAIL (2025-08-07 20:00:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 6.172676682s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X........X..................................] duration: 1.970928385s FAIL (2025-08-07 20:00:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.970960416s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X........X.................................] duration: 2.056727071s FAIL (2025-08-07 19:59:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 2.056750225s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.900833144s FAIL (2025-08-07 19:59:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 5.900856729s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X........X................................] duration: 1.996583982s FAIL (2025-08-07 19:59:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.996613298s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 7.172761404s FAIL (2025-08-07 19:58:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 7.172788937s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X........X...............................] duration: 2.043998166s FAIL (2025-08-07 19:57:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 2.044025877s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.452118752s FAIL (2025-08-07 19:57:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 6.45214385s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X........X..............................] duration: 1.858654787s FAIL (2025-08-07 19:57:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.858684905s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.921488982s FAIL (2025-08-07 19:56:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 5.921518158s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X........X.............................] duration: 1.85321034s FAIL (2025-08-07 19:56:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.853235857s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X........X............................] duration: 1.913509328s FAIL (2025-08-07 19:56:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.913531141s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.153946828s FAIL (2025-08-07 19:55:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 6.153973428s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.882051718s FAIL (2025-08-07 19:55:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 5.882076435s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X........X...........................] duration: 1.919626342s FAIL (2025-08-07 19:54:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.919646782s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.027810314s FAIL (2025-08-07 19:54:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 6.027837987s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X........X..........................] duration: 1.856723999s FAIL (2025-08-07 19:54:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.85674446s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 5.963708178s FAIL (2025-08-07 19:53:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 2841c2a4adc3ef6ee2be0cfadbe17fc50579a592d1e82624920713652b06fb3b != before 7af7b154986991265ba07aa1bd731028a28b5efbe6089662af5810c8dd1ec00b ======LOGS====== 62]: Upload finished. err: <nil> Aug 7 19:53:40.922172963 (10h13m40.51151795s) [upload=10670]: Starting upload Aug 7 19:53:40.922216857 (10h13m40.511561844s) [upload=10670]: Done starting upload Aug 7 19:53:40.922381082 (10h13m40.511726069s) [upload=10670]: Uploading segments... Aug 7 19:53:40.922407162 (10h13m40.511752149s) [upload=10670]: Got next segment. Inline: false Aug 7 19:53:40.922430857 (10h13m40.511775844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:53:40.922434454 (10h13m40.511779441s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:53:41.380723724 (10h13m40.970068701s) [seg_pos={0 0}, upload=10670]: Begin upload segment... Aug 7 19:53:41.380761207 (10h13m40.970106194s) [seg_pos={0 0}, upload=10670]: Done begin upload segment. Aug 7 19:53:41.380782768 (10h13m40.970127755s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381139450 (10h13m40.970484427s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381501052 (10h13m40.970846039s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381780056 (10h13m40.971125043s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.381956824 (10h13m40.971301811s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382355347 (10h13m40.971700334s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382615203 (10h13m40.971960191s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.382969522 (10h13m40.972314499s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383280416 (10h13m40.972625403s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383584408 (10h13m40.972929385s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383785784 (10h13m40.973130771s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.383985636 (10h13m40.973330623s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384321849 (10h13m40.973666826s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384560165 (10h13m40.973905152s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384763063 (10h13m40.97410805s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.384958006 (10h13m40.974302983s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.385143080 (10h13m40.974488067s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:41.386114388 (10h13m40.975459375s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Uploading piece... Aug 7 19:53:42.554215420 (10h13m42.143560397s) [upload=10670]: Next returned nil segment Aug 7 19:53:42.554246900 (10h13m42.143591887s) [upload=10670]: Waiting for error group managing segments... Aug 7 19:53:42.863996224 (10h13m42.453341211s) [noise=true , address=64.49.13.26:4948 , piece_id=VHYR6RNXDHVJWJUHE5L3ADNL6NGXIPKOEBVJJTJINPEYMUCL54VA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:42.868849701 (10h13m42.458194678s) [noise=true , address=64.49.13.27:4963 , piece_id=22MFHEK73U677LTKNOYCQDQWNSBGEFPOHZPOVVO4MBDL5NDFG2HQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.320522161 (10h13m42.909867148s) [noise=true , address=104.36.82.47:4536 , piece_id=KHKYUPCCGL3PTYLI76CUVS7B2TZRCORW5OPO6O6CCEKOTOMKBXNQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.322183751 (10h13m42.911528738s) [noise=true , address=104.36.82.34:4576 , piece_id=DZQMFV2LEPFIFFCQLBUJDKN2BNY6UVQY3PKUU6NZSIJJGR7FXHRQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.343115137 (10h13m42.932460124s) [noise=true , address=104.36.82.60:4339 , piece_id=VBDYKPFAAEAFGXFDZ3DVFQLP53UOLOFYDXPRJ3YRLK6SP7SE7USQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.368559660 (10h13m42.957904647s) [noise=true , address=104.36.82.54:4188 , piece_id=L5Z5UOPXE5LCXYGVM6DSMUPGAYAQCPC66ZR2DDWYF5BDKH5H747A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.398449267 (10h13m42.987794254s) [noise=true , address=77.90.31.21:4892 , piece_id=WFSQ75JPTHOIFNUXHEDCBA5GZKCWJBFHBRM6HOI6OEOBMTLAT3QA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.399720399 (10h13m42.989065386s) [noise=true , address=45.91.116.14:4195 , piece_id=OFAOQRJK5RWW3YNFETGF4VU6S4SJHOC4XO5SMW3YRC6JBADSPD6Q, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.451495208 (10h13m43.040840195s) [noise=true , address=104.36.82.44:4900 , piece_id=SCQT4SLJ5KT5HATRMYRXERUNIBXXSPY4DZHUCGU4V3ULDMMR3UVQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.458718738 (10h13m43.048063715s) [noise=true , address=45.91.116.8:4056 , piece_id=65R5KPLAU2G4VPZ7FPB7N6ELULXWGQVQC2AMB3GWJAIFK3HRMNWQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.486066823 (10h13m43.07541181s) [noise=true , address=104.36.82.36:4621 , piece_id=WNVSDY7TKLAYMM6LBYF5LCIAU6AQUUVC23UISRARJA3ATQWPJPTQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.528568240 (10h13m43.117913227s) [noise=true , address=104.36.82.45:4933 , piece_id=KBTPUEXUDXGFQNWOBIKLSDF2FANTRUEFNQKODB4ZM5E5KQEROTAA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.531899534 (10h13m43.121244521s) [noise=true , address=104.36.82.59:4321 , piece_id=VBM3TZBGBRMF2QFIPGIRPQDYUTTGH7PJE5VWSQ6PHVXQNQLQZMJQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607393333 (10h13m43.19673832s) [noise=true , address=104.36.82.23:4474 , piece_id=UVMUHP5GZWGUUGLBJRNVHVWXMBZIZ4DL27BFK2GNY5MQMZ7KPUIA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: <nil> Aug 7 19:53:43.607425625 (10h13m43.196770612s) [seg_pos={0 0}, upload=10670]: Segment reached optimal threshold of 14 pieces. Aug 7 19:53:43.607558028 (10h13m43.196903016s) [noise=true , address=104.36.82.43:4866 , piece_id=NNR52E6OOJSWCANR7H3JWXTMVHTAXWYNTYEIL5SB7MECLY4NCVSQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1284LFJc9JfU3bP1kkafrVxGVmvyd5enCTzc8hSGpG4EVr2KRxQ): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607653841 (10h13m43.196998828s) [noise=true , address=104.36.82.44:4871 , piece_id=33AYI2C2TZMQ7UWW3EZQ5YZZNO6J2VDHDJGK7YARJY5DNFKXSFOQ, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.607697024 (10h13m43.197042011s) [noise=true , address=104.36.82.46:4483 , piece_id=DSXWDMHUNBGO45KCNPDYJQMI4P24BY3UCLMEZCYB3ZJGAFGQ6QOA, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1igSs2ZGX3zWVsSdmm1pnwYd7JckcyBubTuNU1gJDxQsZ9nKaY): protocol: expected piece hash; context canceled; EOF Aug 7 19:53:43.608028218 (10h13m43.197373205s) [noise=true , address=104.36.82.62:4441 , piece_id=BHI3NI5KZESCVI2WZ6L6ALEDUY6HAWQK6W26M6PUKISFMIVW3G3A, seg_pos={0 0}, upload=10670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VBayWisMK1n3cwypeiLzGuffonBTzYga7thAZ8pSqrusc7kow): protocol: context canceled; context canceled Aug 7 19:53:43.608090186 (10h13m43.197435183s) [seg_pos={0 0}, upload=10670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:53:43.608200357 (10h13m43.197545354s) [upload=10670]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:53:43.608205847 (10h13m43.197550844s) [upload=10670]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:53:43.920192863 (10h13m43.50953785s) [upload=10670]: Done uploading segments... Aug 7 19:53:43.920211939 (10h13m43.509556926s) [upload=10670]: Upload finished. err: <nil> Duration: 5.963772111s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X........X.........................] duration: 1.981141317s FAIL (2025-08-07 19:53:29 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.981173809s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X........X........................] duration: 1.846184918s FAIL (2025-08-07 19:52:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.846208945s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................X........X.......................] duration: 1.854059195s FAIL (2025-08-07 19:51:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.854086046s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................X........X......................] duration: 1.824364828s FAIL (2025-08-07 19:51:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.824384978s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................X........X.....................] duration: 1.859082676s FAIL (2025-08-07 19:50:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.859105969s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.041765039s FAIL (2025-08-07 19:49:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== =9811]: Uploading segments... Aug 7 19:04:12.273931080 (9h24m11.863276067s) [upload=9811]: Got next segment. Inline: false Aug 7 19:04:12.274006835 (9h24m11.863351823s) [upload=9811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:12.274011725 (9h24m11.863356702s) [upload=9811]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:04:12.717864015 (9h24m12.307209002s) [seg_pos={0 0}, upload=9811]: Begin upload segment... Aug 7 19:04:12.717911636 (9h24m12.307256623s) [seg_pos={0 0}, upload=9811]: Done begin upload segment. Aug 7 19:04:12.717932836 (9h24m12.307277823s) [noise=true , address=104.36.82.58:4279 , piece_id=DRVGX3U2RVWWTDWTBNIRMBVJP4MWGCJKQ4CJNSXXH66WJUSEKIXA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.717971501 (9h24m12.307316498s) [noise=true , address=104.36.82.15:4267 , piece_id=6Y627WAZEB7FQ6FVLSOBHZY445UWPPVTCXDU4WNBWWKDI63O2UNA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.718456990 (9h24m12.307801977s) [noise=true , address=104.36.82.43:4845 , piece_id=SHA54UGBQXHXTBEYIFE3SLLERZAIEDF4AK6G3S7YXOIU3PBXEPDQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.718545539 (9h24m12.307890526s) [noise=true , address=104.36.82.5:4866 , piece_id=PJMGUWJF765C3G2UEN3JAM5HTVLYJI73SOBCUDX7AE3CMFJBZPMQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.718798202 (9h24m12.308143189s) [noise=true , address=104.36.82.59:4308 , piece_id=JB3HUWNCM2BPE4IAUEJXM7DZTKXVKH3BSUFL4WYJUOPEEKKWYTXQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.718904957 (9h24m12.308249944s) [noise=true , address=104.36.82.23:4453 , piece_id=7ETC3JOZLBQWLPLD7V5CEAKUTN2NHCEIWOXG2X2MBKGS7PGT5BGQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719112313 (9h24m12.3084573s) [noise=true , address=104.36.82.2:4736 , piece_id=45J7CVQM4OI6BOTIFQSUXHIVMJ3K3LKI4I4YEM7THANMFR7TPBFQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719182157 (9h24m12.308527144s) [noise=true , address=104.36.82.46:4502 , piece_id=OASXKJZFE2JJWBJAZGIFJB5U3RNIFHS3Q2IW7E2GXE6RV5DYA6HA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719442745 (9h24m12.308787722s) [noise=true , address=104.36.82.60:4363 , piece_id=TJXC7IVJHTTON3LCHSMEHBTJYB6PCLKKGFNK6OQAJIBX5YVLJ64A, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719458175 (9h24m12.308803162s) [noise=true , address=104.36.82.16:4324 , piece_id=PBXPML2PLS7AXTRLEHXMUW47UQAXINKRXLRBDNHAWAXMU7EFB5AA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719720877 (9h24m12.309065864s) [noise=true , address=45.91.116.7:4031 , piece_id=JO625IB7HL5BSH7LCYOOV6F54MZNBZF2UTWWHVWE6WB5JTDEASMQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719805901 (9h24m12.309150908s) [noise=true , address=104.36.82.4:4831 , piece_id=J7WI3SK3EV3VJTQVJFIRWNST5GDDRVEWDYSF5CKWAT2R4VZFHYVA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.720124269 (9h24m12.309469256s) [noise=true , address=104.36.82.62:4409 , piece_id=XZTRAXD5DC3XAE3PWDVBLTJ4AW6TOU4XD5LZDWMGFE42AI42P2GA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.720266952 (9h24m12.309611939s) [noise=true , address=104.36.82.17:4348 , piece_id=CS6OSUTFQZ5OTV5JKHTYIBR3GM7K6KGZSVQBQS6WWPAGPR5UCEGA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.720459661 (9h24m12.309804648s) [noise=true , address=79.127.205.234:4599 , piece_id=SIEAB3SBKO5DMWUQK65XIAG5X3OLVLTZQYWRWONYPC3FU6PMUFLQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.720607645 (9h24m12.309952632s) [noise=true , address=104.36.82.44:4870 , piece_id=YWYYRXU2WE7JU5W2SN2WC2NPMMCWDWWKCBCO4ID2OTXQJ7JFYXVA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.720811244 (9h24m12.310156231s) [noise=true , address=104.36.82.35:4589 , piece_id=3ZFRO4FATGT6ILXHWGZNGZIZRJQIAATMEK73D6CJHLMDWRKKXP4A, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.721050341 (9h24m12.310395329s) [noise=true , address=104.36.82.53:4142 , piece_id=HWSPUPW5ESCUNESSIPDTNOL5UCCS43AXROB5CJ65J2JUYUPJAD3A, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:13.779417755 (9h24m13.368762733s) [upload=9811]: Next returned nil segment Aug 7 19:04:13.779436351 (9h24m13.368781338s) [upload=9811]: Waiting for error group managing segments... Aug 7 19:04:14.170293026 (9h24m13.759638013s) [noise=true , address=79.127.205.234:4599 , piece_id=SIEAB3SBKO5DMWUQK65XIAG5X3OLVLTZQYWRWONYPC3FU6PMUFLQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.633221203 (9h24m14.22256619s) [noise=true , address=104.36.82.2:4736 , piece_id=45J7CVQM4OI6BOTIFQSUXHIVMJ3K3LKI4I4YEM7THANMFR7TPBFQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.644767184 (9h24m14.234112171s) [noise=true , address=104.36.82.23:4453 , piece_id=7ETC3JOZLBQWLPLD7V5CEAKUTN2NHCEIWOXG2X2MBKGS7PGT5BGQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.724454327 (9h24m14.313799304s) [noise=true , address=104.36.82.46:4502 , piece_id=OASXKJZFE2JJWBJAZGIFJB5U3RNIFHS3Q2IW7E2GXE6RV5DYA6HA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.735198443 (9h24m14.32454342s) [noise=true , address=104.36.82.35:4589 , piece_id=3ZFRO4FATGT6ILXHWGZNGZIZRJQIAATMEK73D6CJHLMDWRKKXP4A, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.768653773 (9h24m14.35799875s) [noise=true , address=104.36.82.59:4308 , piece_id=JB3HUWNCM2BPE4IAUEJXM7DZTKXVKH3BSUFL4WYJUOPEEKKWYTXQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.782851717 (9h24m14.372196704s) [noise=true , address=104.36.82.4:4831 , piece_id=J7WI3SK3EV3VJTQVJFIRWNST5GDDRVEWDYSF5CKWAT2R4VZFHYVA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.795000971 (9h24m14.384346009s) [noise=true , address=104.36.82.58:4279 , piece_id=DRVGX3U2RVWWTDWTBNIRMBVJP4MWGCJKQ4CJNSXXH66WJUSEKIXA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.822994261 (9h24m14.412339248s) [noise=true , address=104.36.82.44:4870 , piece_id=YWYYRXU2WE7JU5W2SN2WC2NPMMCWDWWKCBCO4ID2OTXQJ7JFYXVA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.828488021 (9h24m14.417833008s) [noise=true , address=104.36.82.53:4142 , piece_id=HWSPUPW5ESCUNESSIPDTNOL5UCCS43AXROB5CJ65J2JUYUPJAD3A, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.835064614 (9h24m14.424409601s) [noise=true , address=104.36.82.17:4348 , piece_id=CS6OSUTFQZ5OTV5JKHTYIBR3GM7K6KGZSVQBQS6WWPAGPR5UCEGA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.865975906 (9h24m14.455320923s) [noise=true , address=104.36.82.16:4324 , piece_id=PBXPML2PLS7AXTRLEHXMUW47UQAXINKRXLRBDNHAWAXMU7EFB5AA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.990330359 (9h24m14.579675346s) [noise=true , address=104.36.82.60:4363 , piece_id=TJXC7IVJHTTON3LCHSMEHBTJYB6PCLKKGFNK6OQAJIBX5YVLJ64A, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:15.206641502 (9h24m14.795986489s) [noise=true , address=45.91.116.7:4031 , piece_id=JO625IB7HL5BSH7LCYOOV6F54MZNBZF2UTWWHVWE6WB5JTDEASMQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:15.206675617 (9h24m14.796020614s) [seg_pos={0 0}, upload=9811]: Segment reached optimal threshold of 14 pieces. Aug 7 19:04:15.206994617 (9h24m14.796339614s) [noise=true , address=104.36.82.5:4866 , piece_id=PJMGUWJF765C3G2UEN3JAM5HTVLYJI73SOBCUDX7AE3CMFJBZPMQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:58036->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:58036->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58036->104.36.82.5:4866: use of closed network connection Aug 7 19:04:15.207030646 (9h24m14.796375633s) [noise=true , address=104.36.82.43:4845 , piece_id=SHA54UGBQXHXTBEYIFE3SLLERZAIEDF4AK6G3S7YXOIU3PBXEPDQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bgD3PwFrAz1UmQvd8V2rNAf7dFMbjrUEvn1ATTpSM85HijKHS): protocol: expected piece hash; context canceled; EOF Aug 7 19:04:15.207219327 (9h24m14.796564314s) [noise=true , address=104.36.82.15:4267 , piece_id=6Y627WAZEB7FQ6FVLSOBHZY445UWPPVTCXDU4WNBWWKDI63O2UNA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF Aug 7 19:04:15.207229436 (9h24m14.796574443s) [noise=true , address=104.36.82.62:4409 , piece_id=XZTRAXD5DC3XAE3PWDVBLTJ4AW6TOU4XD5LZDWMGFE42AI42P2GA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj): protocol: read tcp 188.166.225.170:44866->104.36.82.62:4409: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:04:15.207247130 (9h24m14.796592127s) [seg_pos={0 0}, upload=9811]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:04:15.207332914 (9h24m14.796677911s) [upload=9811]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:04:15.207338064 (9h24m14.796683051s) [upload=9811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:15.559132112 (9h24m15.148477109s) [upload=9811]: Done uploading segments... Aug 7 19:04:15.559205572 (9h24m15.148550599s) [upload=9811]: Upload finished. err: <nil> Duration: 6.041791239s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................X........X....................] duration: 1.852869936s FAIL (2025-08-07 19:49:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 1.852893551s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.112411162s FAIL (2025-08-07 19:48:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== =9811]: Uploading segments... Aug 7 19:04:12.273931080 (9h24m11.863276067s) [upload=9811]: Got next segment. Inline: false Aug 7 19:04:12.274006835 (9h24m11.863351823s) [upload=9811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:12.274011725 (9h24m11.863356702s) [upload=9811]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:04:12.717864015 (9h24m12.307209002s) [seg_pos={0 0}, upload=9811]: Begin upload segment... Aug 7 19:04:12.717911636 (9h24m12.307256623s) [seg_pos={0 0}, upload=9811]: Done begin upload segment. Aug 7 19:04:12.717932836 (9h24m12.307277823s) [noise=true , address=104.36.82.58:4279 , piece_id=DRVGX3U2RVWWTDWTBNIRMBVJP4MWGCJKQ4CJNSXXH66WJUSEKIXA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.717971501 (9h24m12.307316498s) [noise=true , address=104.36.82.15:4267 , piece_id=6Y627WAZEB7FQ6FVLSOBHZY445UWPPVTCXDU4WNBWWKDI63O2UNA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.718456990 (9h24m12.307801977s) [noise=true , address=104.36.82.43:4845 , piece_id=SHA54UGBQXHXTBEYIFE3SLLERZAIEDF4AK6G3S7YXOIU3PBXEPDQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.718545539 (9h24m12.307890526s) [noise=true , address=104.36.82.5:4866 , piece_id=PJMGUWJF765C3G2UEN3JAM5HTVLYJI73SOBCUDX7AE3CMFJBZPMQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.718798202 (9h24m12.308143189s) [noise=true , address=104.36.82.59:4308 , piece_id=JB3HUWNCM2BPE4IAUEJXM7DZTKXVKH3BSUFL4WYJUOPEEKKWYTXQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.718904957 (9h24m12.308249944s) [noise=true , address=104.36.82.23:4453 , piece_id=7ETC3JOZLBQWLPLD7V5CEAKUTN2NHCEIWOXG2X2MBKGS7PGT5BGQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719112313 (9h24m12.3084573s) [noise=true , address=104.36.82.2:4736 , piece_id=45J7CVQM4OI6BOTIFQSUXHIVMJ3K3LKI4I4YEM7THANMFR7TPBFQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719182157 (9h24m12.308527144s) [noise=true , address=104.36.82.46:4502 , piece_id=OASXKJZFE2JJWBJAZGIFJB5U3RNIFHS3Q2IW7E2GXE6RV5DYA6HA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719442745 (9h24m12.308787722s) [noise=true , address=104.36.82.60:4363 , piece_id=TJXC7IVJHTTON3LCHSMEHBTJYB6PCLKKGFNK6OQAJIBX5YVLJ64A, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719458175 (9h24m12.308803162s) [noise=true , address=104.36.82.16:4324 , piece_id=PBXPML2PLS7AXTRLEHXMUW47UQAXINKRXLRBDNHAWAXMU7EFB5AA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719720877 (9h24m12.309065864s) [noise=true , address=45.91.116.7:4031 , piece_id=JO625IB7HL5BSH7LCYOOV6F54MZNBZF2UTWWHVWE6WB5JTDEASMQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.719805901 (9h24m12.309150908s) [noise=true , address=104.36.82.4:4831 , piece_id=J7WI3SK3EV3VJTQVJFIRWNST5GDDRVEWDYSF5CKWAT2R4VZFHYVA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.720124269 (9h24m12.309469256s) [noise=true , address=104.36.82.62:4409 , piece_id=XZTRAXD5DC3XAE3PWDVBLTJ4AW6TOU4XD5LZDWMGFE42AI42P2GA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.720266952 (9h24m12.309611939s) [noise=true , address=104.36.82.17:4348 , piece_id=CS6OSUTFQZ5OTV5JKHTYIBR3GM7K6KGZSVQBQS6WWPAGPR5UCEGA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.720459661 (9h24m12.309804648s) [noise=true , address=79.127.205.234:4599 , piece_id=SIEAB3SBKO5DMWUQK65XIAG5X3OLVLTZQYWRWONYPC3FU6PMUFLQ, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.720607645 (9h24m12.309952632s) [noise=true , address=104.36.82.44:4870 , piece_id=YWYYRXU2WE7JU5W2SN2WC2NPMMCWDWWKCBCO4ID2OTXQJ7JFYXVA, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.720811244 (9h24m12.310156231s) [noise=true , address=104.36.82.35:4589 , piece_id=3ZFRO4FATGT6ILXHWGZNGZIZRJQIAATMEK73D6CJHLMDWRKKXP4A, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:12.721050341 (9h24m12.310395329s) [noise=true , address=104.36.82.53:4142 , piece_id=HWSPUPW5ESCUNESSIPDTNOL5UCCS43AXROB5CJ65J2JUYUPJAD3A, seg_pos={0 0}, upload=9811]: Uploading piece... Aug 7 19:04:13.779417755 (9h24m13.368762733s) [upload=9811]: Next returned nil segment Aug 7 19:04:13.779436351 (9h24m13.368781338s) [upload=9811]: Waiting for error group managing segments... Aug 7 19:04:14.170293026 (9h24m13.759638013s) [noise=true , address=79.127.205.234:4599 , piece_id=SIEAB3SBKO5DMWUQK65XIAG5X3OLVLTZQYWRWONYPC3FU6PMUFLQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.633221203 (9h24m14.22256619s) [noise=true , address=104.36.82.2:4736 , piece_id=45J7CVQM4OI6BOTIFQSUXHIVMJ3K3LKI4I4YEM7THANMFR7TPBFQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.644767184 (9h24m14.234112171s) [noise=true , address=104.36.82.23:4453 , piece_id=7ETC3JOZLBQWLPLD7V5CEAKUTN2NHCEIWOXG2X2MBKGS7PGT5BGQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.724454327 (9h24m14.313799304s) [noise=true , address=104.36.82.46:4502 , piece_id=OASXKJZFE2JJWBJAZGIFJB5U3RNIFHS3Q2IW7E2GXE6RV5DYA6HA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.735198443 (9h24m14.32454342s) [noise=true , address=104.36.82.35:4589 , piece_id=3ZFRO4FATGT6ILXHWGZNGZIZRJQIAATMEK73D6CJHLMDWRKKXP4A, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.768653773 (9h24m14.35799875s) [noise=true , address=104.36.82.59:4308 , piece_id=JB3HUWNCM2BPE4IAUEJXM7DZTKXVKH3BSUFL4WYJUOPEEKKWYTXQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.782851717 (9h24m14.372196704s) [noise=true , address=104.36.82.4:4831 , piece_id=J7WI3SK3EV3VJTQVJFIRWNST5GDDRVEWDYSF5CKWAT2R4VZFHYVA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.795000971 (9h24m14.384346009s) [noise=true , address=104.36.82.58:4279 , piece_id=DRVGX3U2RVWWTDWTBNIRMBVJP4MWGCJKQ4CJNSXXH66WJUSEKIXA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.822994261 (9h24m14.412339248s) [noise=true , address=104.36.82.44:4870 , piece_id=YWYYRXU2WE7JU5W2SN2WC2NPMMCWDWWKCBCO4ID2OTXQJ7JFYXVA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.828488021 (9h24m14.417833008s) [noise=true , address=104.36.82.53:4142 , piece_id=HWSPUPW5ESCUNESSIPDTNOL5UCCS43AXROB5CJ65J2JUYUPJAD3A, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.835064614 (9h24m14.424409601s) [noise=true , address=104.36.82.17:4348 , piece_id=CS6OSUTFQZ5OTV5JKHTYIBR3GM7K6KGZSVQBQS6WWPAGPR5UCEGA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.865975906 (9h24m14.455320923s) [noise=true , address=104.36.82.16:4324 , piece_id=PBXPML2PLS7AXTRLEHXMUW47UQAXINKRXLRBDNHAWAXMU7EFB5AA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:14.990330359 (9h24m14.579675346s) [noise=true , address=104.36.82.60:4363 , piece_id=TJXC7IVJHTTON3LCHSMEHBTJYB6PCLKKGFNK6OQAJIBX5YVLJ64A, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:15.206641502 (9h24m14.795986489s) [noise=true , address=45.91.116.7:4031 , piece_id=JO625IB7HL5BSH7LCYOOV6F54MZNBZF2UTWWHVWE6WB5JTDEASMQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: <nil> Aug 7 19:04:15.206675617 (9h24m14.796020614s) [seg_pos={0 0}, upload=9811]: Segment reached optimal threshold of 14 pieces. Aug 7 19:04:15.206994617 (9h24m14.796339614s) [noise=true , address=104.36.82.5:4866 , piece_id=PJMGUWJF765C3G2UEN3JAM5HTVLYJI73SOBCUDX7AE3CMFJBZPMQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zUcYfJE8xRW2Tow7bGB3PeNrVBUzVWR82JADkVwPdSr4CTPyr): protocol: write tcp 188.166.225.170:58036->104.36.82.5:4866: use of closed network connection; write tcp 188.166.225.170:58036->104.36.82.5:4866: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58036->104.36.82.5:4866: use of closed network connection Aug 7 19:04:15.207030646 (9h24m14.796375633s) [noise=true , address=104.36.82.43:4845 , piece_id=SHA54UGBQXHXTBEYIFE3SLLERZAIEDF4AK6G3S7YXOIU3PBXEPDQ, seg_pos={0 0}, upload=9811]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bgD3PwFrAz1UmQvd8V2rNAf7dFMbjrUEvn1ATTpSM85HijKHS): protocol: expected piece hash; context canceled; EOF Aug 7 19:04:15.207219327 (9h24m14.796564314s) [noise=true , address=104.36.82.15:4267 , piece_id=6Y627WAZEB7FQ6FVLSOBHZY445UWPPVTCXDU4WNBWWKDI63O2UNA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Tn9Ta9jyvkhsbyeATvZWfadDxVGHBU5PyE3fD3nVWh2Y9Kaf7): protocol: expected piece hash; context canceled; EOF Aug 7 19:04:15.207229436 (9h24m14.796574443s) [noise=true , address=104.36.82.62:4409 , piece_id=XZTRAXD5DC3XAE3PWDVBLTJ4AW6TOU4XD5LZDWMGFE42AI42P2GA, seg_pos={0 0}, upload=9811]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UoCGA4FjE4yADPXL1oifSPJssPgSGh81REZHwGv2eu1Y1kEaj): protocol: read tcp 188.166.225.170:44866->104.36.82.62:4409: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:04:15.207247130 (9h24m14.796592127s) [seg_pos={0 0}, upload=9811]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:04:15.207332914 (9h24m14.796677911s) [upload=9811]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:04:15.207338064 (9h24m14.796683051s) [upload=9811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:15.559132112 (9h24m15.148477109s) [upload=9811]: Done uploading segments... Aug 7 19:04:15.559205572 (9h24m15.148550599s) [upload=9811]: Upload finished. err: <nil> Duration: 6.112439996s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X........X...................] duration: 2.008157285s FAIL (2025-08-07 19:48:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== m_ObjectCommit Aug 7 19:27:10.160678358 (9h47m9.750023345s) [upload=10193]: Done uploading segments... Aug 7 19:27:10.160694838 (9h47m9.750039826s) [upload=10193]: Upload finished. err: <nil> Aug 7 19:27:51.977227626 (9h47m51.566572613s) [upload=10208]: Starting upload Aug 7 19:27:51.977292090 (9h47m51.566637067s) [upload=10208]: Done starting upload Aug 7 19:27:51.977366050 (9h47m51.566711037s) [upload=10208]: Uploading segments... Aug 7 19:27:51.977404835 (9h47m51.566749822s) [upload=10208]: Got next segment. Inline: true Aug 7 19:27:51.977408833 (9h47m51.56675382s) [upload=10208]: Waiting for error group managing segments... Aug 7 19:27:51.977441455 (9h47m51.566786442s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:27:51.977445262 (9h47m51.566790249s) [upload=10208]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:27:51.977447556 (9h47m51.566792543s) [upload=10208]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:52.192621107 (9h47m51.781966094s) [upload=10208]: Done uploading segments... Aug 7 19:27:52.192637719 (9h47m51.781982706s) [upload=10208]: Upload finished. err: metaclient: Too Many Requests Aug 7 19:28:33.238514538 (9h48m32.827859525s) [upload=10221]: Starting upload Aug 7 19:28:33.238562180 (9h48m32.827907157s) [upload=10221]: Done starting upload Aug 7 19:28:33.238627795 (9h48m32.827972782s) [upload=10221]: Uploading segments... Aug 7 19:28:33.238663914 (9h48m32.828008891s) [upload=10221]: Got next segment. Inline: true Aug 7 19:28:33.238667501 (9h48m32.828012488s) [upload=10221]: Waiting for error group managing segments... Aug 7 19:28:33.238704382 (9h48m32.828049429s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:33.238711796 (9h48m32.828056783s) [upload=10221]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:33.238715493 (9h48m32.82806049s) [upload=10221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:33.658266417 (9h48m33.247611404s) [upload=10221]: Done uploading segments... Aug 7 19:28:33.658283299 (9h48m33.247628286s) [upload=10221]: Upload finished. err: <nil> Aug 7 19:28:51.361704008 (9h48m50.951048995s) [upload=10225]: Starting upload Aug 7 19:28:51.361752521 (9h48m50.951097508s) [upload=10225]: Done starting upload Aug 7 19:28:51.361814239 (9h48m50.951159226s) [upload=10225]: Uploading segments... Aug 7 19:28:51.361846150 (9h48m50.951191137s) [upload=10225]: Got next segment. Inline: true Aug 7 19:28:51.361849707 (9h48m50.951194695s) [upload=10225]: Waiting for error group managing segments... Aug 7 19:28:51.361880727 (9h48m50.951225714s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:51.361884544 (9h48m50.951229531s) [upload=10225]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:51.361886908 (9h48m50.951231895s) [upload=10225]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:51.634702903 (9h48m51.22404789s) [upload=10225]: Done uploading segments... Aug 7 19:28:51.634737349 (9h48m51.224082326s) [upload=10225]: Upload finished. err: <nil> Aug 7 19:29:12.220554896 (9h49m11.809899883s) [upload=10233]: Starting upload Aug 7 19:29:12.220627544 (9h49m11.809972551s) [upload=10233]: Done starting upload Aug 7 19:29:12.220708579 (9h49m11.810053576s) [upload=10233]: Uploading segments... Aug 7 19:29:12.220803531 (9h49m11.810148518s) [upload=10233]: Got next segment. Inline: true Aug 7 19:29:12.220809533 (9h49m11.81015452s) [upload=10233]: Waiting for error group managing segments... Aug 7 19:29:12.220871651 (9h49m11.810216638s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:12.220877713 (9h49m11.810222701s) [upload=10233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:12.220880960 (9h49m11.810225947s) [upload=10233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:12.573045808 (9h49m12.162390795s) [upload=10233]: Done uploading segments... Aug 7 19:29:12.573091345 (9h49m12.162436332s) [upload=10233]: Upload finished. err: <nil> Aug 7 19:29:41.735121145 (9h49m41.324466132s) [upload=10244]: Starting upload Aug 7 19:29:41.735168356 (9h49m41.324513363s) [upload=10244]: Done starting upload Aug 7 19:29:41.735255312 (9h49m41.324600289s) [upload=10244]: Uploading segments... Aug 7 19:29:41.735311500 (9h49m41.324656487s) [upload=10244]: Got next segment. Inline: true Aug 7 19:29:41.735314926 (9h49m41.324659913s) [upload=10244]: Waiting for error group managing segments... Aug 7 19:29:41.735368448 (9h49m41.324713435s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:41.735372626 (9h49m41.324717613s) [upload=10244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:41.735374870 (9h49m41.324719858s) [upload=10244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:42.000903022 (9h49m41.590248009s) [upload=10244]: Done uploading segments... Aug 7 19:29:42.000921688 (9h49m41.590266675s) [upload=10244]: Upload finished. err: <nil> Aug 7 19:30:09.357577819 (9h50m8.946922806s) [upload=10251]: Starting upload Aug 7 19:30:09.357623787 (9h50m8.946968774s) [upload=10251]: Done starting upload Aug 7 19:30:09.357706075 (9h50m8.947051062s) [upload=10251]: Uploading segments... Aug 7 19:30:09.357828999 (9h50m8.947173986s) [upload=10251]: Got next segment. Inline: true Aug 7 19:30:09.357834209 (9h50m8.947179196s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:30:09.357879085 (9h50m8.947224072s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:09.357883534 (9h50m8.947228521s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:09.357885748 (9h50m8.947230735s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:09.831093883 (9h50m9.42043887s) [upload=10251]: Done uploading segments... Aug 7 19:30:09.831111727 (9h50m9.420456714s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:30:31.706676511 (9h50m31.296021498s) [upload=10259]: Starting upload Aug 7 19:30:31.706715425 (9h50m31.296060413s) [upload=10259]: Done starting upload Aug 7 19:30:31.706962198 (9h50m31.296307185s) [upload=10259]: Uploading segments... Aug 7 19:30:31.706996403 (9h50m31.29634138s) [upload=10259]: Got next segment. Inline: true Aug 7 19:30:31.707006341 (9h50m31.296351329s) [upload=10259]: Waiting for error group managing segments... Aug 7 19:30:31.707042211 (9h50m31.296387198s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:31.707046168 (9h50m31.296391155s) [upload=10259]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:31.707049004 (9h50m31.296393991s) [upload=10259]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:32.134768857 (9h50m31.724113844s) [upload=10259]: Done uploading segments... Aug 7 19:30:32.134809155 (9h50m31.724154142s) [upload=10259]: Upload finished. err: <nil> Aug 7 19:31:14.642237281 (9h51m14.231582268s) [upload=10273]: Starting upload Aug 7 19:31:14.642283008 (9h51m14.231627995s) [upload=10273]: Done starting upload Aug 7 19:31:14.642334347 (9h51m14.231679324s) [upload=10273]: Uploading segments... Aug 7 19:31:14.642388370 (9h51m14.231733357s) [upload=10273]: Got next segment. Inline: true Aug 7 19:31:14.642395824 (9h51m14.231740841s) [upload=10273]: Waiting for error group managing segments... Aug 7 19:31:14.642450859 (9h51m14.231795876s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:14.642458204 (9h51m14.231803231s) [upload=10273]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:14.642463464 (9h51m14.231808481s) [upload=10273]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:14.916538458 (9h51m14.505883465s) [upload=10273]: Done uploading segments... Aug 7 19:31:14.916565079 (9h51m14.505910066s) [upload=10273]: Upload finished. err: <nil> Aug 7 19:31:59.580470078 (9h51m59.169815065s) [upload=10283]: Starting upload Aug 7 19:31:59.580508693 (9h51m59.16985368s) [upload=10283]: Done starting upload Aug 7 19:31:59.580563077 (9h51m59.169908064s) [upload=10283]: Uploading segments... Aug 7 19:31:59.580599707 (9h51m59.169944694s) [upload=10283]: Got next segment. Inline: true Aug 7 19:31:59.580603684 (9h51m59.169948671s) [upload=10283]: Waiting for error group managing segments... Aug 7 19:31:59.580637348 (9h51m59.169982335s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:59.580640916 (9h51m59.169985893s) [upload=10283]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:59.580643240 (9h51m59.169988227s) [upload=10283]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:59.894471131 (9h51m59.483816118s) [upload=10283]: Done uploading segments... Aug 7 19:31:59.894488253 (9h51m59.48383323s) [upload=10283]: Upload finished. err: <nil> Aug 7 19:32:38.308640915 (9h52m37.897985902s) [upload=10295]: Starting upload Aug 7 19:32:38.308709886 (9h52m37.898054873s) [upload=10295]: Done starting upload Aug 7 19:32:38.308805570 (9h52m37.898150557s) [upload=10295]: Uploading segments... Aug 7 19:32:38.308879861 (9h52m37.898224838s) [upload=10295]: Got next segment. Inline: true Aug 7 19:32:38.308884580 (9h52m37.898229567s) [upload=10295]: Waiting for error group managing segments... Aug 7 19:32:38.308924838 (9h52m37.898269825s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:38.308929156 (9h52m37.898274143s) [upload=10295]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:38.308931530 (9h52m37.898276517s) [upload=10295]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:38.590415960 (9h52m38.179760957s) [upload=10295]: Done uploading segments... Aug 7 19:32:38.590438433 (9h52m38.179783421s) [upload=10295]: Upload finished. err: <nil> Duration: 2.008185628s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)