Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X.................................X...............X....X....] duration: 1.8375733s FAIL (2025-08-07 11:17:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:08:23.206502677 (1h28m22.795847664s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:08:23.486896147 (1h28m23.076241124s) [upload=1539]: Done uploading segments... Aug 7 11:08:23.486913369 (1h28m23.076258357s) [upload=1539]: Upload finished. err: <nil> Aug 7 11:09:09.053090663 (1h29m8.64243565s) [upload=1554]: Starting upload Aug 7 11:09:09.053150958 (1h29m8.642495945s) [upload=1554]: Done starting upload Aug 7 11:09:09.053226233 (1h29m8.64257122s) [upload=1554]: Uploading segments... Aug 7 11:09:09.053360289 (1h29m8.642705286s) [upload=1554]: Got next segment. Inline: true Aug 7 11:09:09.053367423 (1h29m8.64271242s) [upload=1554]: Waiting for error group managing segments... Aug 7 11:09:09.053434731 (1h29m8.642779718s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:09.053440492 (1h29m8.642785469s) [upload=1554]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:09.053442827 (1h29m8.642787814s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:09.323042694 (1h29m8.912387681s) [upload=1554]: Done uploading segments... Aug 7 11:09:09.323065918 (1h29m8.912410935s) [upload=1554]: Upload finished. err: <nil> Aug 7 11:09:53.700725757 (1h29m53.290070744s) [upload=1566]: Starting upload Aug 7 11:09:53.700784269 (1h29m53.290129256s) [upload=1566]: Done starting upload Aug 7 11:09:53.700851147 (1h29m53.290196134s) [upload=1566]: Uploading segments... Aug 7 11:09:53.700878068 (1h29m53.290223055s) [upload=1566]: Got next segment. Inline: true Aug 7 11:09:53.700895662 (1h29m53.290240649s) [upload=1566]: Waiting for error group managing segments... Aug 7 11:09:53.700928885 (1h29m53.290273873s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:53.700932592 (1h29m53.29027758s) [upload=1566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:53.700936700 (1h29m53.290281687s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:53.991283642 (1h29m53.58062863s) [upload=1566]: Done uploading segments... Aug 7 11:09:53.991302078 (1h29m53.580647055s) [upload=1566]: Upload finished. err: <nil> Aug 7 11:10:18.597354457 (1h30m18.186699444s) [upload=1573]: Starting upload Aug 7 11:10:18.597413980 (1h30m18.186758957s) [upload=1573]: Done starting upload Aug 7 11:10:18.597467834 (1h30m18.186812821s) [upload=1573]: Uploading segments... Aug 7 11:10:18.597504503 (1h30m18.1868495s) [upload=1573]: Got next segment. Inline: true Aug 7 11:10:18.597509032 (1h30m18.186854019s) [upload=1573]: Waiting for error group managing segments... Aug 7 11:10:18.597548949 (1h30m18.186893936s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:10:18.597554038 (1h30m18.186899025s) [upload=1573]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:10:18.597556844 (1h30m18.186901841s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:10:18.881651073 (1h30m18.47099606s) [upload=1573]: Done uploading segments... Aug 7 11:10:18.881675630 (1h30m18.471020667s) [upload=1573]: Upload finished. err: <nil> Aug 7 11:11:04.334988889 (1h31m3.924333876s) [upload=1585]: Starting upload Aug 7 11:11:04.335046088 (1h31m3.924391075s) [upload=1585]: Done starting upload Aug 7 11:11:04.335116203 (1h31m3.92446119s) [upload=1585]: Uploading segments... Aug 7 11:11:04.335163783 (1h31m3.92450877s) [upload=1585]: Got next segment. Inline: true Aug 7 11:11:04.335167912 (1h31m3.924512899s) [upload=1585]: Waiting for error group managing segments... Aug 7 11:11:04.335205613 (1h31m3.924550591s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:04.335209040 (1h31m3.924554027s) [upload=1585]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:04.335211685 (1h31m3.924556672s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:04.615824694 (1h31m4.205169681s) [upload=1585]: Done uploading segments... Aug 7 11:11:04.615851816 (1h31m4.205196793s) [upload=1585]: Upload finished. err: <nil> Aug 7 11:11:28.808474153 (1h31m28.39781914s) [upload=1593]: Starting upload Aug 7 11:11:28.808518859 (1h31m28.397863846s) [upload=1593]: Done starting upload Aug 7 11:11:28.808565909 (1h31m28.397910896s) [upload=1593]: Uploading segments... Aug 7 11:11:28.808594454 (1h31m28.397939431s) [upload=1593]: Got next segment. Inline: true Aug 7 11:11:28.808598491 (1h31m28.397943478s) [upload=1593]: Waiting for error group managing segments... Aug 7 11:11:28.808629801 (1h31m28.397974778s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:28.808658726 (1h31m28.398003714s) [upload=1593]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:28.808661191 (1h31m28.398006178s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:29.093152140 (1h31m28.682497157s) [upload=1593]: Done uploading segments... Aug 7 11:11:29.093175785 (1h31m28.682520783s) [upload=1593]: Upload finished. err: <nil> Aug 7 11:11:54.747678191 (1h31m54.337023178s) [upload=1602]: Starting upload Aug 7 11:11:54.747726634 (1h31m54.337071621s) [upload=1602]: Done starting upload Aug 7 11:11:54.747822577 (1h31m54.337167564s) [upload=1602]: Uploading segments... Aug 7 11:11:54.747862253 (1h31m54.33720724s) [upload=1602]: Got next segment. Inline: true Aug 7 11:11:54.747866622 (1h31m54.337211599s) [upload=1602]: Waiting for error group managing segments... Aug 7 11:11:54.747907200 (1h31m54.337252187s) [upload=1602]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:54.747911638 (1h31m54.337256625s) [upload=1602]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:54.747914493 (1h31m54.33725948s) [upload=1602]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:55.019333088 (1h31m54.608678076s) [upload=1602]: Done uploading segments... Aug 7 11:11:55.019350622 (1h31m54.608695609s) [upload=1602]: Upload finished. err: <nil> Aug 7 11:12:14.249147716 (1h32m13.838492703s) [upload=1611]: Starting upload Aug 7 11:12:14.249233060 (1h32m13.838578047s) [upload=1611]: Done starting upload Aug 7 11:12:14.249330195 (1h32m13.838675182s) [upload=1611]: Uploading segments... Aug 7 11:12:14.249394047 (1h32m13.838739064s) [upload=1611]: Got next segment. Inline: true Aug 7 11:12:14.249399508 (1h32m13.838744506s) [upload=1611]: Waiting for error group managing segments... Aug 7 11:12:14.249467688 (1h32m13.838812675s) [upload=1611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:12:14.249473740 (1h32m13.838818727s) [upload=1611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:12:14.249476996 (1h32m13.838821993s) [upload=1611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:12:14.556248443 (1h32m14.14559343s) [upload=1611]: Done uploading segments... Aug 7 11:12:14.556270255 (1h32m14.145615242s) [upload=1611]: Upload finished. err: <nil> Aug 7 11:13:18.641395627 (1h33m18.230740614s) [upload=1629]: Starting upload Aug 7 11:13:18.641446465 (1h33m18.230791452s) [upload=1629]: Done starting upload Aug 7 11:13:18.641498644 (1h33m18.230843632s) [upload=1629]: Uploading segments... Aug 7 11:13:18.641528151 (1h33m18.230873138s) [upload=1629]: Got next segment. Inline: true Aug 7 11:13:18.641531657 (1h33m18.230876644s) [upload=1629]: Waiting for error group managing segments... Aug 7 11:13:18.641566724 (1h33m18.230911711s) [upload=1629]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:13:18.641571062 (1h33m18.230916039s) [upload=1629]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:13:18.641573558 (1h33m18.230918545s) [upload=1629]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:13:18.942618277 (1h33m18.531963264s) [upload=1629]: Done uploading segments... Aug 7 11:13:18.942636623 (1h33m18.53198161s) [upload=1629]: Upload finished. err: <nil> Aug 7 11:13:55.866555403 (1h33m55.45590039s) [upload=1642]: Starting upload Aug 7 11:13:55.866602674 (1h33m55.455947651s) [upload=1642]: Done starting upload Aug 7 11:13:55.866655866 (1h33m55.456000853s) [upload=1642]: Uploading segments... Aug 7 11:13:55.866687256 (1h33m55.456032243s) [upload=1642]: Got next segment. Inline: true Aug 7 11:13:55.866691043 (1h33m55.45603603s) [upload=1642]: Waiting for error group managing segments... Aug 7 11:13:55.866721892 (1h33m55.456066879s) [upload=1642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:13:55.866725719 (1h33m55.456070706s) [upload=1642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:13:55.866727883 (1h33m55.45607287s) [upload=1642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:13:56.146662245 (1h33m55.736007232s) [upload=1642]: Done uploading segments... Aug 7 11:13:56.146680549 (1h33m55.736025526s) [upload=1642]: Upload finished. err: <nil> Aug 7 11:14:29.187552960 (1h34m28.776897937s) [upload=1654]: Starting upload Aug 7 11:14:29.187628254 (1h34m28.776973251s) [upload=1654]: Done starting upload Aug 7 11:14:29.187708989 (1h34m28.777053976s) [upload=1654]: Uploading segments... Aug 7 11:14:29.187809802 (1h34m28.777154789s) [upload=1654]: Got next segment. Inline: true Aug 7 11:14:29.187815052 (1h34m28.777160039s) [upload=1654]: Waiting for error group managing segments... Aug 7 11:14:29.187880667 (1h34m28.777225654s) [upload=1654]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:14:29.187884755 (1h34m28.777229742s) [upload=1654]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:14:29.187887110 (1h34m28.777232097s) [upload=1654]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:14:29.464227935 (1h34m29.053572952s) [upload=1654]: Done uploading segments... Aug 7 11:14:29.464248394 (1h34m29.053593391s) [upload=1654]: Upload finished. err: <nil> Duration: 1.837611462s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X..X...X........................X.................] duration: 5.598017436s FAIL (2025-08-07 11:16:36 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.598039498s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.................................X...............X....X...] duration: 1.831999918s FAIL (2025-08-07 11:16:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:08:23.206502677 (1h28m22.795847664s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:08:23.486896147 (1h28m23.076241124s) [upload=1539]: Done uploading segments... Aug 7 11:08:23.486913369 (1h28m23.076258357s) [upload=1539]: Upload finished. err: <nil> Aug 7 11:09:09.053090663 (1h29m8.64243565s) [upload=1554]: Starting upload Aug 7 11:09:09.053150958 (1h29m8.642495945s) [upload=1554]: Done starting upload Aug 7 11:09:09.053226233 (1h29m8.64257122s) [upload=1554]: Uploading segments... Aug 7 11:09:09.053360289 (1h29m8.642705286s) [upload=1554]: Got next segment. Inline: true Aug 7 11:09:09.053367423 (1h29m8.64271242s) [upload=1554]: Waiting for error group managing segments... Aug 7 11:09:09.053434731 (1h29m8.642779718s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:09.053440492 (1h29m8.642785469s) [upload=1554]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:09.053442827 (1h29m8.642787814s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:09.323042694 (1h29m8.912387681s) [upload=1554]: Done uploading segments... Aug 7 11:09:09.323065918 (1h29m8.912410935s) [upload=1554]: Upload finished. err: <nil> Aug 7 11:09:53.700725757 (1h29m53.290070744s) [upload=1566]: Starting upload Aug 7 11:09:53.700784269 (1h29m53.290129256s) [upload=1566]: Done starting upload Aug 7 11:09:53.700851147 (1h29m53.290196134s) [upload=1566]: Uploading segments... Aug 7 11:09:53.700878068 (1h29m53.290223055s) [upload=1566]: Got next segment. Inline: true Aug 7 11:09:53.700895662 (1h29m53.290240649s) [upload=1566]: Waiting for error group managing segments... Aug 7 11:09:53.700928885 (1h29m53.290273873s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:53.700932592 (1h29m53.29027758s) [upload=1566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:53.700936700 (1h29m53.290281687s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:53.991283642 (1h29m53.58062863s) [upload=1566]: Done uploading segments... Aug 7 11:09:53.991302078 (1h29m53.580647055s) [upload=1566]: Upload finished. err: <nil> Aug 7 11:10:18.597354457 (1h30m18.186699444s) [upload=1573]: Starting upload Aug 7 11:10:18.597413980 (1h30m18.186758957s) [upload=1573]: Done starting upload Aug 7 11:10:18.597467834 (1h30m18.186812821s) [upload=1573]: Uploading segments... Aug 7 11:10:18.597504503 (1h30m18.1868495s) [upload=1573]: Got next segment. Inline: true Aug 7 11:10:18.597509032 (1h30m18.186854019s) [upload=1573]: Waiting for error group managing segments... Aug 7 11:10:18.597548949 (1h30m18.186893936s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:10:18.597554038 (1h30m18.186899025s) [upload=1573]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:10:18.597556844 (1h30m18.186901841s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:10:18.881651073 (1h30m18.47099606s) [upload=1573]: Done uploading segments... Aug 7 11:10:18.881675630 (1h30m18.471020667s) [upload=1573]: Upload finished. err: <nil> Aug 7 11:11:04.334988889 (1h31m3.924333876s) [upload=1585]: Starting upload Aug 7 11:11:04.335046088 (1h31m3.924391075s) [upload=1585]: Done starting upload Aug 7 11:11:04.335116203 (1h31m3.92446119s) [upload=1585]: Uploading segments... Aug 7 11:11:04.335163783 (1h31m3.92450877s) [upload=1585]: Got next segment. Inline: true Aug 7 11:11:04.335167912 (1h31m3.924512899s) [upload=1585]: Waiting for error group managing segments... Aug 7 11:11:04.335205613 (1h31m3.924550591s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:04.335209040 (1h31m3.924554027s) [upload=1585]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:04.335211685 (1h31m3.924556672s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:04.615824694 (1h31m4.205169681s) [upload=1585]: Done uploading segments... Aug 7 11:11:04.615851816 (1h31m4.205196793s) [upload=1585]: Upload finished. err: <nil> Aug 7 11:11:28.808474153 (1h31m28.39781914s) [upload=1593]: Starting upload Aug 7 11:11:28.808518859 (1h31m28.397863846s) [upload=1593]: Done starting upload Aug 7 11:11:28.808565909 (1h31m28.397910896s) [upload=1593]: Uploading segments... Aug 7 11:11:28.808594454 (1h31m28.397939431s) [upload=1593]: Got next segment. Inline: true Aug 7 11:11:28.808598491 (1h31m28.397943478s) [upload=1593]: Waiting for error group managing segments... Aug 7 11:11:28.808629801 (1h31m28.397974778s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:28.808658726 (1h31m28.398003714s) [upload=1593]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:28.808661191 (1h31m28.398006178s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:29.093152140 (1h31m28.682497157s) [upload=1593]: Done uploading segments... Aug 7 11:11:29.093175785 (1h31m28.682520783s) [upload=1593]: Upload finished. err: <nil> Aug 7 11:11:54.747678191 (1h31m54.337023178s) [upload=1602]: Starting upload Aug 7 11:11:54.747726634 (1h31m54.337071621s) [upload=1602]: Done starting upload Aug 7 11:11:54.747822577 (1h31m54.337167564s) [upload=1602]: Uploading segments... Aug 7 11:11:54.747862253 (1h31m54.33720724s) [upload=1602]: Got next segment. Inline: true Aug 7 11:11:54.747866622 (1h31m54.337211599s) [upload=1602]: Waiting for error group managing segments... Aug 7 11:11:54.747907200 (1h31m54.337252187s) [upload=1602]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:54.747911638 (1h31m54.337256625s) [upload=1602]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:54.747914493 (1h31m54.33725948s) [upload=1602]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:55.019333088 (1h31m54.608678076s) [upload=1602]: Done uploading segments... Aug 7 11:11:55.019350622 (1h31m54.608695609s) [upload=1602]: Upload finished. err: <nil> Aug 7 11:12:14.249147716 (1h32m13.838492703s) [upload=1611]: Starting upload Aug 7 11:12:14.249233060 (1h32m13.838578047s) [upload=1611]: Done starting upload Aug 7 11:12:14.249330195 (1h32m13.838675182s) [upload=1611]: Uploading segments... Aug 7 11:12:14.249394047 (1h32m13.838739064s) [upload=1611]: Got next segment. Inline: true Aug 7 11:12:14.249399508 (1h32m13.838744506s) [upload=1611]: Waiting for error group managing segments... Aug 7 11:12:14.249467688 (1h32m13.838812675s) [upload=1611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:12:14.249473740 (1h32m13.838818727s) [upload=1611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:12:14.249476996 (1h32m13.838821993s) [upload=1611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:12:14.556248443 (1h32m14.14559343s) [upload=1611]: Done uploading segments... Aug 7 11:12:14.556270255 (1h32m14.145615242s) [upload=1611]: Upload finished. err: <nil> Aug 7 11:13:18.641395627 (1h33m18.230740614s) [upload=1629]: Starting upload Aug 7 11:13:18.641446465 (1h33m18.230791452s) [upload=1629]: Done starting upload Aug 7 11:13:18.641498644 (1h33m18.230843632s) [upload=1629]: Uploading segments... Aug 7 11:13:18.641528151 (1h33m18.230873138s) [upload=1629]: Got next segment. Inline: true Aug 7 11:13:18.641531657 (1h33m18.230876644s) [upload=1629]: Waiting for error group managing segments... Aug 7 11:13:18.641566724 (1h33m18.230911711s) [upload=1629]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:13:18.641571062 (1h33m18.230916039s) [upload=1629]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:13:18.641573558 (1h33m18.230918545s) [upload=1629]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:13:18.942618277 (1h33m18.531963264s) [upload=1629]: Done uploading segments... Aug 7 11:13:18.942636623 (1h33m18.53198161s) [upload=1629]: Upload finished. err: <nil> Aug 7 11:13:55.866555403 (1h33m55.45590039s) [upload=1642]: Starting upload Aug 7 11:13:55.866602674 (1h33m55.455947651s) [upload=1642]: Done starting upload Aug 7 11:13:55.866655866 (1h33m55.456000853s) [upload=1642]: Uploading segments... Aug 7 11:13:55.866687256 (1h33m55.456032243s) [upload=1642]: Got next segment. Inline: true Aug 7 11:13:55.866691043 (1h33m55.45603603s) [upload=1642]: Waiting for error group managing segments... Aug 7 11:13:55.866721892 (1h33m55.456066879s) [upload=1642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:13:55.866725719 (1h33m55.456070706s) [upload=1642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:13:55.866727883 (1h33m55.45607287s) [upload=1642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:13:56.146662245 (1h33m55.736007232s) [upload=1642]: Done uploading segments... Aug 7 11:13:56.146680549 (1h33m55.736025526s) [upload=1642]: Upload finished. err: <nil> Aug 7 11:14:29.187552960 (1h34m28.776897937s) [upload=1654]: Starting upload Aug 7 11:14:29.187628254 (1h34m28.776973251s) [upload=1654]: Done starting upload Aug 7 11:14:29.187708989 (1h34m28.777053976s) [upload=1654]: Uploading segments... Aug 7 11:14:29.187809802 (1h34m28.777154789s) [upload=1654]: Got next segment. Inline: true Aug 7 11:14:29.187815052 (1h34m28.777160039s) [upload=1654]: Waiting for error group managing segments... Aug 7 11:14:29.187880667 (1h34m28.777225654s) [upload=1654]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:14:29.187884755 (1h34m28.777229742s) [upload=1654]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:14:29.187887110 (1h34m28.777232097s) [upload=1654]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:14:29.464227935 (1h34m29.053572952s) [upload=1654]: Done uploading segments... Aug 7 11:14:29.464248394 (1h34m29.053593391s) [upload=1654]: Upload finished. err: <nil> Duration: 1.832023894s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X.................................X...............X....X..] duration: 1.916884105s FAIL (2025-08-07 11:16:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:08:23.206502677 (1h28m22.795847664s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:08:23.486896147 (1h28m23.076241124s) [upload=1539]: Done uploading segments... Aug 7 11:08:23.486913369 (1h28m23.076258357s) [upload=1539]: Upload finished. err: <nil> Aug 7 11:09:09.053090663 (1h29m8.64243565s) [upload=1554]: Starting upload Aug 7 11:09:09.053150958 (1h29m8.642495945s) [upload=1554]: Done starting upload Aug 7 11:09:09.053226233 (1h29m8.64257122s) [upload=1554]: Uploading segments... Aug 7 11:09:09.053360289 (1h29m8.642705286s) [upload=1554]: Got next segment. Inline: true Aug 7 11:09:09.053367423 (1h29m8.64271242s) [upload=1554]: Waiting for error group managing segments... Aug 7 11:09:09.053434731 (1h29m8.642779718s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:09.053440492 (1h29m8.642785469s) [upload=1554]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:09.053442827 (1h29m8.642787814s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:09.323042694 (1h29m8.912387681s) [upload=1554]: Done uploading segments... Aug 7 11:09:09.323065918 (1h29m8.912410935s) [upload=1554]: Upload finished. err: <nil> Aug 7 11:09:53.700725757 (1h29m53.290070744s) [upload=1566]: Starting upload Aug 7 11:09:53.700784269 (1h29m53.290129256s) [upload=1566]: Done starting upload Aug 7 11:09:53.700851147 (1h29m53.290196134s) [upload=1566]: Uploading segments... Aug 7 11:09:53.700878068 (1h29m53.290223055s) [upload=1566]: Got next segment. Inline: true Aug 7 11:09:53.700895662 (1h29m53.290240649s) [upload=1566]: Waiting for error group managing segments... Aug 7 11:09:53.700928885 (1h29m53.290273873s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:53.700932592 (1h29m53.29027758s) [upload=1566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:53.700936700 (1h29m53.290281687s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:53.991283642 (1h29m53.58062863s) [upload=1566]: Done uploading segments... Aug 7 11:09:53.991302078 (1h29m53.580647055s) [upload=1566]: Upload finished. err: <nil> Aug 7 11:10:18.597354457 (1h30m18.186699444s) [upload=1573]: Starting upload Aug 7 11:10:18.597413980 (1h30m18.186758957s) [upload=1573]: Done starting upload Aug 7 11:10:18.597467834 (1h30m18.186812821s) [upload=1573]: Uploading segments... Aug 7 11:10:18.597504503 (1h30m18.1868495s) [upload=1573]: Got next segment. Inline: true Aug 7 11:10:18.597509032 (1h30m18.186854019s) [upload=1573]: Waiting for error group managing segments... Aug 7 11:10:18.597548949 (1h30m18.186893936s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:10:18.597554038 (1h30m18.186899025s) [upload=1573]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:10:18.597556844 (1h30m18.186901841s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:10:18.881651073 (1h30m18.47099606s) [upload=1573]: Done uploading segments... Aug 7 11:10:18.881675630 (1h30m18.471020667s) [upload=1573]: Upload finished. err: <nil> Aug 7 11:11:04.334988889 (1h31m3.924333876s) [upload=1585]: Starting upload Aug 7 11:11:04.335046088 (1h31m3.924391075s) [upload=1585]: Done starting upload Aug 7 11:11:04.335116203 (1h31m3.92446119s) [upload=1585]: Uploading segments... Aug 7 11:11:04.335163783 (1h31m3.92450877s) [upload=1585]: Got next segment. Inline: true Aug 7 11:11:04.335167912 (1h31m3.924512899s) [upload=1585]: Waiting for error group managing segments... Aug 7 11:11:04.335205613 (1h31m3.924550591s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:04.335209040 (1h31m3.924554027s) [upload=1585]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:04.335211685 (1h31m3.924556672s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:04.615824694 (1h31m4.205169681s) [upload=1585]: Done uploading segments... Aug 7 11:11:04.615851816 (1h31m4.205196793s) [upload=1585]: Upload finished. err: <nil> Aug 7 11:11:28.808474153 (1h31m28.39781914s) [upload=1593]: Starting upload Aug 7 11:11:28.808518859 (1h31m28.397863846s) [upload=1593]: Done starting upload Aug 7 11:11:28.808565909 (1h31m28.397910896s) [upload=1593]: Uploading segments... Aug 7 11:11:28.808594454 (1h31m28.397939431s) [upload=1593]: Got next segment. Inline: true Aug 7 11:11:28.808598491 (1h31m28.397943478s) [upload=1593]: Waiting for error group managing segments... Aug 7 11:11:28.808629801 (1h31m28.397974778s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:28.808658726 (1h31m28.398003714s) [upload=1593]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:28.808661191 (1h31m28.398006178s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:29.093152140 (1h31m28.682497157s) [upload=1593]: Done uploading segments... Aug 7 11:11:29.093175785 (1h31m28.682520783s) [upload=1593]: Upload finished. err: <nil> Aug 7 11:11:54.747678191 (1h31m54.337023178s) [upload=1602]: Starting upload Aug 7 11:11:54.747726634 (1h31m54.337071621s) [upload=1602]: Done starting upload Aug 7 11:11:54.747822577 (1h31m54.337167564s) [upload=1602]: Uploading segments... Aug 7 11:11:54.747862253 (1h31m54.33720724s) [upload=1602]: Got next segment. Inline: true Aug 7 11:11:54.747866622 (1h31m54.337211599s) [upload=1602]: Waiting for error group managing segments... Aug 7 11:11:54.747907200 (1h31m54.337252187s) [upload=1602]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:54.747911638 (1h31m54.337256625s) [upload=1602]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:54.747914493 (1h31m54.33725948s) [upload=1602]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:55.019333088 (1h31m54.608678076s) [upload=1602]: Done uploading segments... Aug 7 11:11:55.019350622 (1h31m54.608695609s) [upload=1602]: Upload finished. err: <nil> Aug 7 11:12:14.249147716 (1h32m13.838492703s) [upload=1611]: Starting upload Aug 7 11:12:14.249233060 (1h32m13.838578047s) [upload=1611]: Done starting upload Aug 7 11:12:14.249330195 (1h32m13.838675182s) [upload=1611]: Uploading segments... Aug 7 11:12:14.249394047 (1h32m13.838739064s) [upload=1611]: Got next segment. Inline: true Aug 7 11:12:14.249399508 (1h32m13.838744506s) [upload=1611]: Waiting for error group managing segments... Aug 7 11:12:14.249467688 (1h32m13.838812675s) [upload=1611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:12:14.249473740 (1h32m13.838818727s) [upload=1611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:12:14.249476996 (1h32m13.838821993s) [upload=1611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:12:14.556248443 (1h32m14.14559343s) [upload=1611]: Done uploading segments... Aug 7 11:12:14.556270255 (1h32m14.145615242s) [upload=1611]: Upload finished. err: <nil> Aug 7 11:13:18.641395627 (1h33m18.230740614s) [upload=1629]: Starting upload Aug 7 11:13:18.641446465 (1h33m18.230791452s) [upload=1629]: Done starting upload Aug 7 11:13:18.641498644 (1h33m18.230843632s) [upload=1629]: Uploading segments... Aug 7 11:13:18.641528151 (1h33m18.230873138s) [upload=1629]: Got next segment. Inline: true Aug 7 11:13:18.641531657 (1h33m18.230876644s) [upload=1629]: Waiting for error group managing segments... Aug 7 11:13:18.641566724 (1h33m18.230911711s) [upload=1629]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:13:18.641571062 (1h33m18.230916039s) [upload=1629]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:13:18.641573558 (1h33m18.230918545s) [upload=1629]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:13:18.942618277 (1h33m18.531963264s) [upload=1629]: Done uploading segments... Aug 7 11:13:18.942636623 (1h33m18.53198161s) [upload=1629]: Upload finished. err: <nil> Aug 7 11:13:55.866555403 (1h33m55.45590039s) [upload=1642]: Starting upload Aug 7 11:13:55.866602674 (1h33m55.455947651s) [upload=1642]: Done starting upload Aug 7 11:13:55.866655866 (1h33m55.456000853s) [upload=1642]: Uploading segments... Aug 7 11:13:55.866687256 (1h33m55.456032243s) [upload=1642]: Got next segment. Inline: true Aug 7 11:13:55.866691043 (1h33m55.45603603s) [upload=1642]: Waiting for error group managing segments... Aug 7 11:13:55.866721892 (1h33m55.456066879s) [upload=1642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:13:55.866725719 (1h33m55.456070706s) [upload=1642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:13:55.866727883 (1h33m55.45607287s) [upload=1642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:13:56.146662245 (1h33m55.736007232s) [upload=1642]: Done uploading segments... Aug 7 11:13:56.146680549 (1h33m55.736025526s) [upload=1642]: Upload finished. err: <nil> Aug 7 11:14:29.187552960 (1h34m28.776897937s) [upload=1654]: Starting upload Aug 7 11:14:29.187628254 (1h34m28.776973251s) [upload=1654]: Done starting upload Aug 7 11:14:29.187708989 (1h34m28.777053976s) [upload=1654]: Uploading segments... Aug 7 11:14:29.187809802 (1h34m28.777154789s) [upload=1654]: Got next segment. Inline: true Aug 7 11:14:29.187815052 (1h34m28.777160039s) [upload=1654]: Waiting for error group managing segments... Aug 7 11:14:29.187880667 (1h34m28.777225654s) [upload=1654]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:14:29.187884755 (1h34m28.777229742s) [upload=1654]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:14:29.187887110 (1h34m28.777232097s) [upload=1654]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:14:29.464227935 (1h34m29.053572952s) [upload=1654]: Done uploading segments... Aug 7 11:14:29.464248394 (1h34m29.053593391s) [upload=1654]: Upload finished. err: <nil> Duration: 1.916951313s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X..X...X........................X................] duration: 5.672807138s FAIL (2025-08-07 11:15:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.672830544s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X.................................X...............X....X.] duration: 1.949239575s FAIL (2025-08-07 11:15:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:08:23.206502677 (1h28m22.795847664s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:08:23.486896147 (1h28m23.076241124s) [upload=1539]: Done uploading segments... Aug 7 11:08:23.486913369 (1h28m23.076258357s) [upload=1539]: Upload finished. err: <nil> Aug 7 11:09:09.053090663 (1h29m8.64243565s) [upload=1554]: Starting upload Aug 7 11:09:09.053150958 (1h29m8.642495945s) [upload=1554]: Done starting upload Aug 7 11:09:09.053226233 (1h29m8.64257122s) [upload=1554]: Uploading segments... Aug 7 11:09:09.053360289 (1h29m8.642705286s) [upload=1554]: Got next segment. Inline: true Aug 7 11:09:09.053367423 (1h29m8.64271242s) [upload=1554]: Waiting for error group managing segments... Aug 7 11:09:09.053434731 (1h29m8.642779718s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:09.053440492 (1h29m8.642785469s) [upload=1554]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:09.053442827 (1h29m8.642787814s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:09.323042694 (1h29m8.912387681s) [upload=1554]: Done uploading segments... Aug 7 11:09:09.323065918 (1h29m8.912410935s) [upload=1554]: Upload finished. err: <nil> Aug 7 11:09:53.700725757 (1h29m53.290070744s) [upload=1566]: Starting upload Aug 7 11:09:53.700784269 (1h29m53.290129256s) [upload=1566]: Done starting upload Aug 7 11:09:53.700851147 (1h29m53.290196134s) [upload=1566]: Uploading segments... Aug 7 11:09:53.700878068 (1h29m53.290223055s) [upload=1566]: Got next segment. Inline: true Aug 7 11:09:53.700895662 (1h29m53.290240649s) [upload=1566]: Waiting for error group managing segments... Aug 7 11:09:53.700928885 (1h29m53.290273873s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:53.700932592 (1h29m53.29027758s) [upload=1566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:53.700936700 (1h29m53.290281687s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:53.991283642 (1h29m53.58062863s) [upload=1566]: Done uploading segments... Aug 7 11:09:53.991302078 (1h29m53.580647055s) [upload=1566]: Upload finished. err: <nil> Aug 7 11:10:18.597354457 (1h30m18.186699444s) [upload=1573]: Starting upload Aug 7 11:10:18.597413980 (1h30m18.186758957s) [upload=1573]: Done starting upload Aug 7 11:10:18.597467834 (1h30m18.186812821s) [upload=1573]: Uploading segments... Aug 7 11:10:18.597504503 (1h30m18.1868495s) [upload=1573]: Got next segment. Inline: true Aug 7 11:10:18.597509032 (1h30m18.186854019s) [upload=1573]: Waiting for error group managing segments... Aug 7 11:10:18.597548949 (1h30m18.186893936s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:10:18.597554038 (1h30m18.186899025s) [upload=1573]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:10:18.597556844 (1h30m18.186901841s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:10:18.881651073 (1h30m18.47099606s) [upload=1573]: Done uploading segments... Aug 7 11:10:18.881675630 (1h30m18.471020667s) [upload=1573]: Upload finished. err: <nil> Aug 7 11:11:04.334988889 (1h31m3.924333876s) [upload=1585]: Starting upload Aug 7 11:11:04.335046088 (1h31m3.924391075s) [upload=1585]: Done starting upload Aug 7 11:11:04.335116203 (1h31m3.92446119s) [upload=1585]: Uploading segments... Aug 7 11:11:04.335163783 (1h31m3.92450877s) [upload=1585]: Got next segment. Inline: true Aug 7 11:11:04.335167912 (1h31m3.924512899s) [upload=1585]: Waiting for error group managing segments... Aug 7 11:11:04.335205613 (1h31m3.924550591s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:04.335209040 (1h31m3.924554027s) [upload=1585]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:04.335211685 (1h31m3.924556672s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:04.615824694 (1h31m4.205169681s) [upload=1585]: Done uploading segments... Aug 7 11:11:04.615851816 (1h31m4.205196793s) [upload=1585]: Upload finished. err: <nil> Aug 7 11:11:28.808474153 (1h31m28.39781914s) [upload=1593]: Starting upload Aug 7 11:11:28.808518859 (1h31m28.397863846s) [upload=1593]: Done starting upload Aug 7 11:11:28.808565909 (1h31m28.397910896s) [upload=1593]: Uploading segments... Aug 7 11:11:28.808594454 (1h31m28.397939431s) [upload=1593]: Got next segment. Inline: true Aug 7 11:11:28.808598491 (1h31m28.397943478s) [upload=1593]: Waiting for error group managing segments... Aug 7 11:11:28.808629801 (1h31m28.397974778s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:28.808658726 (1h31m28.398003714s) [upload=1593]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:28.808661191 (1h31m28.398006178s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:29.093152140 (1h31m28.682497157s) [upload=1593]: Done uploading segments... Aug 7 11:11:29.093175785 (1h31m28.682520783s) [upload=1593]: Upload finished. err: <nil> Aug 7 11:11:54.747678191 (1h31m54.337023178s) [upload=1602]: Starting upload Aug 7 11:11:54.747726634 (1h31m54.337071621s) [upload=1602]: Done starting upload Aug 7 11:11:54.747822577 (1h31m54.337167564s) [upload=1602]: Uploading segments... Aug 7 11:11:54.747862253 (1h31m54.33720724s) [upload=1602]: Got next segment. Inline: true Aug 7 11:11:54.747866622 (1h31m54.337211599s) [upload=1602]: Waiting for error group managing segments... Aug 7 11:11:54.747907200 (1h31m54.337252187s) [upload=1602]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:54.747911638 (1h31m54.337256625s) [upload=1602]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:54.747914493 (1h31m54.33725948s) [upload=1602]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:55.019333088 (1h31m54.608678076s) [upload=1602]: Done uploading segments... Aug 7 11:11:55.019350622 (1h31m54.608695609s) [upload=1602]: Upload finished. err: <nil> Aug 7 11:12:14.249147716 (1h32m13.838492703s) [upload=1611]: Starting upload Aug 7 11:12:14.249233060 (1h32m13.838578047s) [upload=1611]: Done starting upload Aug 7 11:12:14.249330195 (1h32m13.838675182s) [upload=1611]: Uploading segments... Aug 7 11:12:14.249394047 (1h32m13.838739064s) [upload=1611]: Got next segment. Inline: true Aug 7 11:12:14.249399508 (1h32m13.838744506s) [upload=1611]: Waiting for error group managing segments... Aug 7 11:12:14.249467688 (1h32m13.838812675s) [upload=1611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:12:14.249473740 (1h32m13.838818727s) [upload=1611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:12:14.249476996 (1h32m13.838821993s) [upload=1611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:12:14.556248443 (1h32m14.14559343s) [upload=1611]: Done uploading segments... Aug 7 11:12:14.556270255 (1h32m14.145615242s) [upload=1611]: Upload finished. err: <nil> Aug 7 11:13:18.641395627 (1h33m18.230740614s) [upload=1629]: Starting upload Aug 7 11:13:18.641446465 (1h33m18.230791452s) [upload=1629]: Done starting upload Aug 7 11:13:18.641498644 (1h33m18.230843632s) [upload=1629]: Uploading segments... Aug 7 11:13:18.641528151 (1h33m18.230873138s) [upload=1629]: Got next segment. Inline: true Aug 7 11:13:18.641531657 (1h33m18.230876644s) [upload=1629]: Waiting for error group managing segments... Aug 7 11:13:18.641566724 (1h33m18.230911711s) [upload=1629]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:13:18.641571062 (1h33m18.230916039s) [upload=1629]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:13:18.641573558 (1h33m18.230918545s) [upload=1629]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:13:18.942618277 (1h33m18.531963264s) [upload=1629]: Done uploading segments... Aug 7 11:13:18.942636623 (1h33m18.53198161s) [upload=1629]: Upload finished. err: <nil> Aug 7 11:13:55.866555403 (1h33m55.45590039s) [upload=1642]: Starting upload Aug 7 11:13:55.866602674 (1h33m55.455947651s) [upload=1642]: Done starting upload Aug 7 11:13:55.866655866 (1h33m55.456000853s) [upload=1642]: Uploading segments... Aug 7 11:13:55.866687256 (1h33m55.456032243s) [upload=1642]: Got next segment. Inline: true Aug 7 11:13:55.866691043 (1h33m55.45603603s) [upload=1642]: Waiting for error group managing segments... Aug 7 11:13:55.866721892 (1h33m55.456066879s) [upload=1642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:13:55.866725719 (1h33m55.456070706s) [upload=1642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:13:55.866727883 (1h33m55.45607287s) [upload=1642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:13:56.146662245 (1h33m55.736007232s) [upload=1642]: Done uploading segments... Aug 7 11:13:56.146680549 (1h33m55.736025526s) [upload=1642]: Upload finished. err: <nil> Aug 7 11:14:29.187552960 (1h34m28.776897937s) [upload=1654]: Starting upload Aug 7 11:14:29.187628254 (1h34m28.776973251s) [upload=1654]: Done starting upload Aug 7 11:14:29.187708989 (1h34m28.777053976s) [upload=1654]: Uploading segments... Aug 7 11:14:29.187809802 (1h34m28.777154789s) [upload=1654]: Got next segment. Inline: true Aug 7 11:14:29.187815052 (1h34m28.777160039s) [upload=1654]: Waiting for error group managing segments... Aug 7 11:14:29.187880667 (1h34m28.777225654s) [upload=1654]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:14:29.187884755 (1h34m28.777229742s) [upload=1654]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:14:29.187887110 (1h34m28.777232097s) [upload=1654]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:14:29.464227935 (1h34m29.053572952s) [upload=1654]: Done uploading segments... Aug 7 11:14:29.464248394 (1h34m29.053593391s) [upload=1654]: Upload finished. err: <nil> Duration: 1.949261988s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X..X...X........................X...............] duration: 5.746420545s FAIL (2025-08-07 11:14:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.746443881s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X.................................X...............X....X] duration: 1.605352996s FAIL (2025-08-07 11:14:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:08:23.206502677 (1h28m22.795847664s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:08:23.486896147 (1h28m23.076241124s) [upload=1539]: Done uploading segments... Aug 7 11:08:23.486913369 (1h28m23.076258357s) [upload=1539]: Upload finished. err: <nil> Aug 7 11:09:09.053090663 (1h29m8.64243565s) [upload=1554]: Starting upload Aug 7 11:09:09.053150958 (1h29m8.642495945s) [upload=1554]: Done starting upload Aug 7 11:09:09.053226233 (1h29m8.64257122s) [upload=1554]: Uploading segments... Aug 7 11:09:09.053360289 (1h29m8.642705286s) [upload=1554]: Got next segment. Inline: true Aug 7 11:09:09.053367423 (1h29m8.64271242s) [upload=1554]: Waiting for error group managing segments... Aug 7 11:09:09.053434731 (1h29m8.642779718s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:09.053440492 (1h29m8.642785469s) [upload=1554]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:09.053442827 (1h29m8.642787814s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:09.323042694 (1h29m8.912387681s) [upload=1554]: Done uploading segments... Aug 7 11:09:09.323065918 (1h29m8.912410935s) [upload=1554]: Upload finished. err: <nil> Aug 7 11:09:53.700725757 (1h29m53.290070744s) [upload=1566]: Starting upload Aug 7 11:09:53.700784269 (1h29m53.290129256s) [upload=1566]: Done starting upload Aug 7 11:09:53.700851147 (1h29m53.290196134s) [upload=1566]: Uploading segments... Aug 7 11:09:53.700878068 (1h29m53.290223055s) [upload=1566]: Got next segment. Inline: true Aug 7 11:09:53.700895662 (1h29m53.290240649s) [upload=1566]: Waiting for error group managing segments... Aug 7 11:09:53.700928885 (1h29m53.290273873s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:53.700932592 (1h29m53.29027758s) [upload=1566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:53.700936700 (1h29m53.290281687s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:53.991283642 (1h29m53.58062863s) [upload=1566]: Done uploading segments... Aug 7 11:09:53.991302078 (1h29m53.580647055s) [upload=1566]: Upload finished. err: <nil> Aug 7 11:10:18.597354457 (1h30m18.186699444s) [upload=1573]: Starting upload Aug 7 11:10:18.597413980 (1h30m18.186758957s) [upload=1573]: Done starting upload Aug 7 11:10:18.597467834 (1h30m18.186812821s) [upload=1573]: Uploading segments... Aug 7 11:10:18.597504503 (1h30m18.1868495s) [upload=1573]: Got next segment. Inline: true Aug 7 11:10:18.597509032 (1h30m18.186854019s) [upload=1573]: Waiting for error group managing segments... Aug 7 11:10:18.597548949 (1h30m18.186893936s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:10:18.597554038 (1h30m18.186899025s) [upload=1573]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:10:18.597556844 (1h30m18.186901841s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:10:18.881651073 (1h30m18.47099606s) [upload=1573]: Done uploading segments... Aug 7 11:10:18.881675630 (1h30m18.471020667s) [upload=1573]: Upload finished. err: <nil> Aug 7 11:11:04.334988889 (1h31m3.924333876s) [upload=1585]: Starting upload Aug 7 11:11:04.335046088 (1h31m3.924391075s) [upload=1585]: Done starting upload Aug 7 11:11:04.335116203 (1h31m3.92446119s) [upload=1585]: Uploading segments... Aug 7 11:11:04.335163783 (1h31m3.92450877s) [upload=1585]: Got next segment. Inline: true Aug 7 11:11:04.335167912 (1h31m3.924512899s) [upload=1585]: Waiting for error group managing segments... Aug 7 11:11:04.335205613 (1h31m3.924550591s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:04.335209040 (1h31m3.924554027s) [upload=1585]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:04.335211685 (1h31m3.924556672s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:04.615824694 (1h31m4.205169681s) [upload=1585]: Done uploading segments... Aug 7 11:11:04.615851816 (1h31m4.205196793s) [upload=1585]: Upload finished. err: <nil> Aug 7 11:11:28.808474153 (1h31m28.39781914s) [upload=1593]: Starting upload Aug 7 11:11:28.808518859 (1h31m28.397863846s) [upload=1593]: Done starting upload Aug 7 11:11:28.808565909 (1h31m28.397910896s) [upload=1593]: Uploading segments... Aug 7 11:11:28.808594454 (1h31m28.397939431s) [upload=1593]: Got next segment. Inline: true Aug 7 11:11:28.808598491 (1h31m28.397943478s) [upload=1593]: Waiting for error group managing segments... Aug 7 11:11:28.808629801 (1h31m28.397974778s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:28.808658726 (1h31m28.398003714s) [upload=1593]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:28.808661191 (1h31m28.398006178s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:29.093152140 (1h31m28.682497157s) [upload=1593]: Done uploading segments... Aug 7 11:11:29.093175785 (1h31m28.682520783s) [upload=1593]: Upload finished. err: <nil> Aug 7 11:11:54.747678191 (1h31m54.337023178s) [upload=1602]: Starting upload Aug 7 11:11:54.747726634 (1h31m54.337071621s) [upload=1602]: Done starting upload Aug 7 11:11:54.747822577 (1h31m54.337167564s) [upload=1602]: Uploading segments... Aug 7 11:11:54.747862253 (1h31m54.33720724s) [upload=1602]: Got next segment. Inline: true Aug 7 11:11:54.747866622 (1h31m54.337211599s) [upload=1602]: Waiting for error group managing segments... Aug 7 11:11:54.747907200 (1h31m54.337252187s) [upload=1602]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:54.747911638 (1h31m54.337256625s) [upload=1602]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:54.747914493 (1h31m54.33725948s) [upload=1602]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:55.019333088 (1h31m54.608678076s) [upload=1602]: Done uploading segments... Aug 7 11:11:55.019350622 (1h31m54.608695609s) [upload=1602]: Upload finished. err: <nil> Aug 7 11:12:14.249147716 (1h32m13.838492703s) [upload=1611]: Starting upload Aug 7 11:12:14.249233060 (1h32m13.838578047s) [upload=1611]: Done starting upload Aug 7 11:12:14.249330195 (1h32m13.838675182s) [upload=1611]: Uploading segments... Aug 7 11:12:14.249394047 (1h32m13.838739064s) [upload=1611]: Got next segment. Inline: true Aug 7 11:12:14.249399508 (1h32m13.838744506s) [upload=1611]: Waiting for error group managing segments... Aug 7 11:12:14.249467688 (1h32m13.838812675s) [upload=1611]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:12:14.249473740 (1h32m13.838818727s) [upload=1611]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:12:14.249476996 (1h32m13.838821993s) [upload=1611]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:12:14.556248443 (1h32m14.14559343s) [upload=1611]: Done uploading segments... Aug 7 11:12:14.556270255 (1h32m14.145615242s) [upload=1611]: Upload finished. err: <nil> Aug 7 11:13:18.641395627 (1h33m18.230740614s) [upload=1629]: Starting upload Aug 7 11:13:18.641446465 (1h33m18.230791452s) [upload=1629]: Done starting upload Aug 7 11:13:18.641498644 (1h33m18.230843632s) [upload=1629]: Uploading segments... Aug 7 11:13:18.641528151 (1h33m18.230873138s) [upload=1629]: Got next segment. Inline: true Aug 7 11:13:18.641531657 (1h33m18.230876644s) [upload=1629]: Waiting for error group managing segments... Aug 7 11:13:18.641566724 (1h33m18.230911711s) [upload=1629]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:13:18.641571062 (1h33m18.230916039s) [upload=1629]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:13:18.641573558 (1h33m18.230918545s) [upload=1629]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:13:18.942618277 (1h33m18.531963264s) [upload=1629]: Done uploading segments... Aug 7 11:13:18.942636623 (1h33m18.53198161s) [upload=1629]: Upload finished. err: <nil> Aug 7 11:13:55.866555403 (1h33m55.45590039s) [upload=1642]: Starting upload Aug 7 11:13:55.866602674 (1h33m55.455947651s) [upload=1642]: Done starting upload Aug 7 11:13:55.866655866 (1h33m55.456000853s) [upload=1642]: Uploading segments... Aug 7 11:13:55.866687256 (1h33m55.456032243s) [upload=1642]: Got next segment. Inline: true Aug 7 11:13:55.866691043 (1h33m55.45603603s) [upload=1642]: Waiting for error group managing segments... Aug 7 11:13:55.866721892 (1h33m55.456066879s) [upload=1642]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:13:55.866725719 (1h33m55.456070706s) [upload=1642]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:13:55.866727883 (1h33m55.45607287s) [upload=1642]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:13:56.146662245 (1h33m55.736007232s) [upload=1642]: Done uploading segments... Aug 7 11:13:56.146680549 (1h33m55.736025526s) [upload=1642]: Upload finished. err: <nil> Aug 7 11:14:29.187552960 (1h34m28.776897937s) [upload=1654]: Starting upload Aug 7 11:14:29.187628254 (1h34m28.776973251s) [upload=1654]: Done starting upload Aug 7 11:14:29.187708989 (1h34m28.777053976s) [upload=1654]: Uploading segments... Aug 7 11:14:29.187809802 (1h34m28.777154789s) [upload=1654]: Got next segment. Inline: true Aug 7 11:14:29.187815052 (1h34m28.777160039s) [upload=1654]: Waiting for error group managing segments... Aug 7 11:14:29.187880667 (1h34m28.777225654s) [upload=1654]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:14:29.187884755 (1h34m28.777229742s) [upload=1654]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:14:29.187887110 (1h34m28.777232097s) [upload=1654]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:14:29.464227935 (1h34m29.053572952s) [upload=1654]: Done uploading segments... Aug 7 11:14:29.464248394 (1h34m29.053593391s) [upload=1654]: Upload finished. err: <nil> Duration: 1.605377946s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X..X...X........................X..............] duration: 5.671965352s FAIL (2025-08-07 11:14:13 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.671988856s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X.................................X...............X....] duration: 1.85334396s FAIL (2025-08-07 11:13:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59db762adb475abe8c082c8408e0bb2feec42755abc0e5049e2c34f5ddd5527a != before 9600c6b69f8ccaa28757129ab7e0009fa1fb7d638f9d51876de63bf6a56a36df ======LOGS====== item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:05:32.723956611 (1h25m32.313301598s) [upload=1491]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:05:33.038262414 (1h25m32.627607411s) [upload=1491]: Done uploading segments... Aug 7 11:05:33.038280648 (1h25m32.627625635s) [upload=1491]: Upload finished. err: <nil> Aug 7 11:06:27.165717085 (1h26m26.755062062s) [upload=1506]: Starting upload Aug 7 11:06:27.165764756 (1h26m26.755109743s) [upload=1506]: Done starting upload Aug 7 11:06:27.165859778 (1h26m26.755204765s) [upload=1506]: Uploading segments... Aug 7 11:06:27.165945301 (1h26m26.755290288s) [upload=1506]: Got next segment. Inline: true Aug 7 11:06:27.165949790 (1h26m26.755294777s) [upload=1506]: Waiting for error group managing segments... Aug 7 11:06:27.165999846 (1h26m26.755344833s) [upload=1506]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:06:27.166004514 (1h26m26.755349501s) [upload=1506]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:06:27.166006879 (1h26m26.755351866s) [upload=1506]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:06:27.461217888 (1h26m27.050562895s) [upload=1506]: Done uploading segments... Aug 7 11:06:27.461244228 (1h26m27.050589235s) [upload=1506]: Upload finished. err: <nil> Aug 7 11:06:51.758067156 (1h26m51.347412153s) [upload=1516]: Starting upload Aug 7 11:06:51.758145406 (1h26m51.347490393s) [upload=1516]: Done starting upload Aug 7 11:06:51.758219668 (1h26m51.347564656s) [upload=1516]: Uploading segments... Aug 7 11:06:51.758268161 (1h26m51.347613179s) [upload=1516]: Got next segment. Inline: true Aug 7 11:06:51.758274043 (1h26m51.34761903s) [upload=1516]: Waiting for error group managing segments... Aug 7 11:06:51.758323187 (1h26m51.347668174s) [upload=1516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:06:51.758328968 (1h26m51.347673955s) [upload=1516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:06:51.758332855 (1h26m51.347677832s) [upload=1516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:06:52.042427305 (1h26m51.631772292s) [upload=1516]: Done uploading segments... Aug 7 11:06:52.042443816 (1h26m51.631788803s) [upload=1516]: Upload finished. err: <nil> Aug 7 11:07:18.108332658 (1h27m17.697677645s) [upload=1523]: Starting upload Aug 7 11:07:18.108389216 (1h27m17.697734203s) [upload=1523]: Done starting upload Aug 7 11:07:18.108445013 (1h27m17.69779s) [upload=1523]: Uploading segments... Aug 7 11:07:18.108475141 (1h27m17.697820128s) [upload=1523]: Got next segment. Inline: true Aug 7 11:07:18.108479218 (1h27m17.697824205s) [upload=1523]: Waiting for error group managing segments... Aug 7 11:07:18.108511189 (1h27m17.697856166s) [upload=1523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:07:18.108514846 (1h27m17.697859833s) [upload=1523]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:07:18.108517130 (1h27m17.697862107s) [upload=1523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:07:18.393523775 (1h27m17.982868772s) [upload=1523]: Done uploading segments... Aug 7 11:07:18.393544465 (1h27m17.982889462s) [upload=1523]: Upload finished. err: <nil> Aug 7 11:07:35.783491476 (1h27m35.372836463s) [upload=1528]: Starting upload Aug 7 11:07:35.783550108 (1h27m35.372895095s) [upload=1528]: Done starting upload Aug 7 11:07:35.783614872 (1h27m35.372959849s) [upload=1528]: Uploading segments... Aug 7 11:07:35.783642465 (1h27m35.372987452s) [upload=1528]: Got next segment. Inline: true Aug 7 11:07:35.783646292 (1h27m35.372991279s) [upload=1528]: Waiting for error group managing segments... Aug 7 11:07:35.783679206 (1h27m35.373024193s) [upload=1528]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:07:35.783683013 (1h27m35.373028s) [upload=1528]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:07:35.783685417 (1h27m35.373030404s) [upload=1528]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:07:36.053267040 (1h27m35.642612027s) [upload=1528]: Done uploading segments... Aug 7 11:07:36.053284914 (1h27m35.642629901s) [upload=1528]: Upload finished. err: <nil> Aug 7 11:08:23.206332742 (1h28m22.795677729s) [upload=1539]: Starting upload Aug 7 11:08:23.206382287 (1h28m22.795727264s) [upload=1539]: Done starting upload Aug 7 11:08:23.206430539 (1h28m22.795775527s) [upload=1539]: Uploading segments... Aug 7 11:08:23.206461519 (1h28m22.795806506s) [upload=1539]: Got next segment. Inline: true Aug 7 11:08:23.206465286 (1h28m22.795810273s) [upload=1539]: Waiting for error group managing segments... Aug 7 11:08:23.206496525 (1h28m22.795841512s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:08:23.206500292 (1h28m22.795845269s) [upload=1539]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:08:23.206502677 (1h28m22.795847664s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:08:23.486896147 (1h28m23.076241124s) [upload=1539]: Done uploading segments... Aug 7 11:08:23.486913369 (1h28m23.076258357s) [upload=1539]: Upload finished. err: <nil> Aug 7 11:09:09.053090663 (1h29m8.64243565s) [upload=1554]: Starting upload Aug 7 11:09:09.053150958 (1h29m8.642495945s) [upload=1554]: Done starting upload Aug 7 11:09:09.053226233 (1h29m8.64257122s) [upload=1554]: Uploading segments... Aug 7 11:09:09.053360289 (1h29m8.642705286s) [upload=1554]: Got next segment. Inline: true Aug 7 11:09:09.053367423 (1h29m8.64271242s) [upload=1554]: Waiting for error group managing segments... Aug 7 11:09:09.053434731 (1h29m8.642779718s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:09.053440492 (1h29m8.642785469s) [upload=1554]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:09.053442827 (1h29m8.642787814s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:09.323042694 (1h29m8.912387681s) [upload=1554]: Done uploading segments... Aug 7 11:09:09.323065918 (1h29m8.912410935s) [upload=1554]: Upload finished. err: <nil> Aug 7 11:09:53.700725757 (1h29m53.290070744s) [upload=1566]: Starting upload Aug 7 11:09:53.700784269 (1h29m53.290129256s) [upload=1566]: Done starting upload Aug 7 11:09:53.700851147 (1h29m53.290196134s) [upload=1566]: Uploading segments... Aug 7 11:09:53.700878068 (1h29m53.290223055s) [upload=1566]: Got next segment. Inline: true Aug 7 11:09:53.700895662 (1h29m53.290240649s) [upload=1566]: Waiting for error group managing segments... Aug 7 11:09:53.700928885 (1h29m53.290273873s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:53.700932592 (1h29m53.29027758s) [upload=1566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:53.700936700 (1h29m53.290281687s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:53.991283642 (1h29m53.58062863s) [upload=1566]: Done uploading segments... Aug 7 11:09:53.991302078 (1h29m53.580647055s) [upload=1566]: Upload finished. err: <nil> Aug 7 11:10:18.597354457 (1h30m18.186699444s) [upload=1573]: Starting upload Aug 7 11:10:18.597413980 (1h30m18.186758957s) [upload=1573]: Done starting upload Aug 7 11:10:18.597467834 (1h30m18.186812821s) [upload=1573]: Uploading segments... Aug 7 11:10:18.597504503 (1h30m18.1868495s) [upload=1573]: Got next segment. Inline: true Aug 7 11:10:18.597509032 (1h30m18.186854019s) [upload=1573]: Waiting for error group managing segments... Aug 7 11:10:18.597548949 (1h30m18.186893936s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:10:18.597554038 (1h30m18.186899025s) [upload=1573]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:10:18.597556844 (1h30m18.186901841s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:10:18.881651073 (1h30m18.47099606s) [upload=1573]: Done uploading segments... Aug 7 11:10:18.881675630 (1h30m18.471020667s) [upload=1573]: Upload finished. err: <nil> Aug 7 11:11:04.334988889 (1h31m3.924333876s) [upload=1585]: Starting upload Aug 7 11:11:04.335046088 (1h31m3.924391075s) [upload=1585]: Done starting upload Aug 7 11:11:04.335116203 (1h31m3.92446119s) [upload=1585]: Uploading segments... Aug 7 11:11:04.335163783 (1h31m3.92450877s) [upload=1585]: Got next segment. Inline: true Aug 7 11:11:04.335167912 (1h31m3.924512899s) [upload=1585]: Waiting for error group managing segments... Aug 7 11:11:04.335205613 (1h31m3.924550591s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:04.335209040 (1h31m3.924554027s) [upload=1585]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:04.335211685 (1h31m3.924556672s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:04.615824694 (1h31m4.205169681s) [upload=1585]: Done uploading segments... Aug 7 11:11:04.615851816 (1h31m4.205196793s) [upload=1585]: Upload finished. err: <nil> Aug 7 11:11:28.808474153 (1h31m28.39781914s) [upload=1593]: Starting upload Aug 7 11:11:28.808518859 (1h31m28.397863846s) [upload=1593]: Done starting upload Aug 7 11:11:28.808565909 (1h31m28.397910896s) [upload=1593]: Uploading segments... Aug 7 11:11:28.808594454 (1h31m28.397939431s) [upload=1593]: Got next segment. Inline: true Aug 7 11:11:28.808598491 (1h31m28.397943478s) [upload=1593]: Waiting for error group managing segments... Aug 7 11:11:28.808629801 (1h31m28.397974778s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:28.808658726 (1h31m28.398003714s) [upload=1593]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:28.808661191 (1h31m28.398006178s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:29.093152140 (1h31m28.682497157s) [upload=1593]: Done uploading segments... Aug 7 11:11:29.093175785 (1h31m28.682520783s) [upload=1593]: Upload finished. err: <nil> Duration: 1.853379098s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X..X...X........................X.............] duration: 5.66278794s FAIL (2025-08-07 11:13:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.662812056s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X.................................X...............X...] duration: 1.872270151s FAIL (2025-08-07 11:13:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59db762adb475abe8c082c8408e0bb2feec42755abc0e5049e2c34f5ddd5527a != before 9600c6b69f8ccaa28757129ab7e0009fa1fb7d638f9d51876de63bf6a56a36df ======LOGS====== item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:05:32.723956611 (1h25m32.313301598s) [upload=1491]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:05:33.038262414 (1h25m32.627607411s) [upload=1491]: Done uploading segments... Aug 7 11:05:33.038280648 (1h25m32.627625635s) [upload=1491]: Upload finished. err: <nil> Aug 7 11:06:27.165717085 (1h26m26.755062062s) [upload=1506]: Starting upload Aug 7 11:06:27.165764756 (1h26m26.755109743s) [upload=1506]: Done starting upload Aug 7 11:06:27.165859778 (1h26m26.755204765s) [upload=1506]: Uploading segments... Aug 7 11:06:27.165945301 (1h26m26.755290288s) [upload=1506]: Got next segment. Inline: true Aug 7 11:06:27.165949790 (1h26m26.755294777s) [upload=1506]: Waiting for error group managing segments... Aug 7 11:06:27.165999846 (1h26m26.755344833s) [upload=1506]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:06:27.166004514 (1h26m26.755349501s) [upload=1506]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:06:27.166006879 (1h26m26.755351866s) [upload=1506]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:06:27.461217888 (1h26m27.050562895s) [upload=1506]: Done uploading segments... Aug 7 11:06:27.461244228 (1h26m27.050589235s) [upload=1506]: Upload finished. err: <nil> Aug 7 11:06:51.758067156 (1h26m51.347412153s) [upload=1516]: Starting upload Aug 7 11:06:51.758145406 (1h26m51.347490393s) [upload=1516]: Done starting upload Aug 7 11:06:51.758219668 (1h26m51.347564656s) [upload=1516]: Uploading segments... Aug 7 11:06:51.758268161 (1h26m51.347613179s) [upload=1516]: Got next segment. Inline: true Aug 7 11:06:51.758274043 (1h26m51.34761903s) [upload=1516]: Waiting for error group managing segments... Aug 7 11:06:51.758323187 (1h26m51.347668174s) [upload=1516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:06:51.758328968 (1h26m51.347673955s) [upload=1516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:06:51.758332855 (1h26m51.347677832s) [upload=1516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:06:52.042427305 (1h26m51.631772292s) [upload=1516]: Done uploading segments... Aug 7 11:06:52.042443816 (1h26m51.631788803s) [upload=1516]: Upload finished. err: <nil> Aug 7 11:07:18.108332658 (1h27m17.697677645s) [upload=1523]: Starting upload Aug 7 11:07:18.108389216 (1h27m17.697734203s) [upload=1523]: Done starting upload Aug 7 11:07:18.108445013 (1h27m17.69779s) [upload=1523]: Uploading segments... Aug 7 11:07:18.108475141 (1h27m17.697820128s) [upload=1523]: Got next segment. Inline: true Aug 7 11:07:18.108479218 (1h27m17.697824205s) [upload=1523]: Waiting for error group managing segments... Aug 7 11:07:18.108511189 (1h27m17.697856166s) [upload=1523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:07:18.108514846 (1h27m17.697859833s) [upload=1523]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:07:18.108517130 (1h27m17.697862107s) [upload=1523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:07:18.393523775 (1h27m17.982868772s) [upload=1523]: Done uploading segments... Aug 7 11:07:18.393544465 (1h27m17.982889462s) [upload=1523]: Upload finished. err: <nil> Aug 7 11:07:35.783491476 (1h27m35.372836463s) [upload=1528]: Starting upload Aug 7 11:07:35.783550108 (1h27m35.372895095s) [upload=1528]: Done starting upload Aug 7 11:07:35.783614872 (1h27m35.372959849s) [upload=1528]: Uploading segments... Aug 7 11:07:35.783642465 (1h27m35.372987452s) [upload=1528]: Got next segment. Inline: true Aug 7 11:07:35.783646292 (1h27m35.372991279s) [upload=1528]: Waiting for error group managing segments... Aug 7 11:07:35.783679206 (1h27m35.373024193s) [upload=1528]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:07:35.783683013 (1h27m35.373028s) [upload=1528]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:07:35.783685417 (1h27m35.373030404s) [upload=1528]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:07:36.053267040 (1h27m35.642612027s) [upload=1528]: Done uploading segments... Aug 7 11:07:36.053284914 (1h27m35.642629901s) [upload=1528]: Upload finished. err: <nil> Aug 7 11:08:23.206332742 (1h28m22.795677729s) [upload=1539]: Starting upload Aug 7 11:08:23.206382287 (1h28m22.795727264s) [upload=1539]: Done starting upload Aug 7 11:08:23.206430539 (1h28m22.795775527s) [upload=1539]: Uploading segments... Aug 7 11:08:23.206461519 (1h28m22.795806506s) [upload=1539]: Got next segment. Inline: true Aug 7 11:08:23.206465286 (1h28m22.795810273s) [upload=1539]: Waiting for error group managing segments... Aug 7 11:08:23.206496525 (1h28m22.795841512s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:08:23.206500292 (1h28m22.795845269s) [upload=1539]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:08:23.206502677 (1h28m22.795847664s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:08:23.486896147 (1h28m23.076241124s) [upload=1539]: Done uploading segments... Aug 7 11:08:23.486913369 (1h28m23.076258357s) [upload=1539]: Upload finished. err: <nil> Aug 7 11:09:09.053090663 (1h29m8.64243565s) [upload=1554]: Starting upload Aug 7 11:09:09.053150958 (1h29m8.642495945s) [upload=1554]: Done starting upload Aug 7 11:09:09.053226233 (1h29m8.64257122s) [upload=1554]: Uploading segments... Aug 7 11:09:09.053360289 (1h29m8.642705286s) [upload=1554]: Got next segment. Inline: true Aug 7 11:09:09.053367423 (1h29m8.64271242s) [upload=1554]: Waiting for error group managing segments... Aug 7 11:09:09.053434731 (1h29m8.642779718s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:09.053440492 (1h29m8.642785469s) [upload=1554]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:09.053442827 (1h29m8.642787814s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:09.323042694 (1h29m8.912387681s) [upload=1554]: Done uploading segments... Aug 7 11:09:09.323065918 (1h29m8.912410935s) [upload=1554]: Upload finished. err: <nil> Aug 7 11:09:53.700725757 (1h29m53.290070744s) [upload=1566]: Starting upload Aug 7 11:09:53.700784269 (1h29m53.290129256s) [upload=1566]: Done starting upload Aug 7 11:09:53.700851147 (1h29m53.290196134s) [upload=1566]: Uploading segments... Aug 7 11:09:53.700878068 (1h29m53.290223055s) [upload=1566]: Got next segment. Inline: true Aug 7 11:09:53.700895662 (1h29m53.290240649s) [upload=1566]: Waiting for error group managing segments... Aug 7 11:09:53.700928885 (1h29m53.290273873s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:53.700932592 (1h29m53.29027758s) [upload=1566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:53.700936700 (1h29m53.290281687s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:53.991283642 (1h29m53.58062863s) [upload=1566]: Done uploading segments... Aug 7 11:09:53.991302078 (1h29m53.580647055s) [upload=1566]: Upload finished. err: <nil> Aug 7 11:10:18.597354457 (1h30m18.186699444s) [upload=1573]: Starting upload Aug 7 11:10:18.597413980 (1h30m18.186758957s) [upload=1573]: Done starting upload Aug 7 11:10:18.597467834 (1h30m18.186812821s) [upload=1573]: Uploading segments... Aug 7 11:10:18.597504503 (1h30m18.1868495s) [upload=1573]: Got next segment. Inline: true Aug 7 11:10:18.597509032 (1h30m18.186854019s) [upload=1573]: Waiting for error group managing segments... Aug 7 11:10:18.597548949 (1h30m18.186893936s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:10:18.597554038 (1h30m18.186899025s) [upload=1573]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:10:18.597556844 (1h30m18.186901841s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:10:18.881651073 (1h30m18.47099606s) [upload=1573]: Done uploading segments... Aug 7 11:10:18.881675630 (1h30m18.471020667s) [upload=1573]: Upload finished. err: <nil> Aug 7 11:11:04.334988889 (1h31m3.924333876s) [upload=1585]: Starting upload Aug 7 11:11:04.335046088 (1h31m3.924391075s) [upload=1585]: Done starting upload Aug 7 11:11:04.335116203 (1h31m3.92446119s) [upload=1585]: Uploading segments... Aug 7 11:11:04.335163783 (1h31m3.92450877s) [upload=1585]: Got next segment. Inline: true Aug 7 11:11:04.335167912 (1h31m3.924512899s) [upload=1585]: Waiting for error group managing segments... Aug 7 11:11:04.335205613 (1h31m3.924550591s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:04.335209040 (1h31m3.924554027s) [upload=1585]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:04.335211685 (1h31m3.924556672s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:04.615824694 (1h31m4.205169681s) [upload=1585]: Done uploading segments... Aug 7 11:11:04.615851816 (1h31m4.205196793s) [upload=1585]: Upload finished. err: <nil> Aug 7 11:11:28.808474153 (1h31m28.39781914s) [upload=1593]: Starting upload Aug 7 11:11:28.808518859 (1h31m28.397863846s) [upload=1593]: Done starting upload Aug 7 11:11:28.808565909 (1h31m28.397910896s) [upload=1593]: Uploading segments... Aug 7 11:11:28.808594454 (1h31m28.397939431s) [upload=1593]: Got next segment. Inline: true Aug 7 11:11:28.808598491 (1h31m28.397943478s) [upload=1593]: Waiting for error group managing segments... Aug 7 11:11:28.808629801 (1h31m28.397974778s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:28.808658726 (1h31m28.398003714s) [upload=1593]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:28.808661191 (1h31m28.398006178s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:29.093152140 (1h31m28.682497157s) [upload=1593]: Done uploading segments... Aug 7 11:11:29.093175785 (1h31m28.682520783s) [upload=1593]: Upload finished. err: <nil> Duration: 1.872294017s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...............X..X...X........................X............] duration: 5.899256881s FAIL (2025-08-07 11:13:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.89928259s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [................X..X...X........................X...........] duration: 5.520633943s FAIL (2025-08-07 11:12:39 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.52065333s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X..X...X........................X..........] duration: 5.632757166s FAIL (2025-08-07 11:12:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.632778777s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X.................................X...............X..] duration: 1.868016193s FAIL (2025-08-07 11:12:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59db762adb475abe8c082c8408e0bb2feec42755abc0e5049e2c34f5ddd5527a != before 9600c6b69f8ccaa28757129ab7e0009fa1fb7d638f9d51876de63bf6a56a36df ======LOGS====== item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:05:32.723956611 (1h25m32.313301598s) [upload=1491]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:05:33.038262414 (1h25m32.627607411s) [upload=1491]: Done uploading segments... Aug 7 11:05:33.038280648 (1h25m32.627625635s) [upload=1491]: Upload finished. err: <nil> Aug 7 11:06:27.165717085 (1h26m26.755062062s) [upload=1506]: Starting upload Aug 7 11:06:27.165764756 (1h26m26.755109743s) [upload=1506]: Done starting upload Aug 7 11:06:27.165859778 (1h26m26.755204765s) [upload=1506]: Uploading segments... Aug 7 11:06:27.165945301 (1h26m26.755290288s) [upload=1506]: Got next segment. Inline: true Aug 7 11:06:27.165949790 (1h26m26.755294777s) [upload=1506]: Waiting for error group managing segments... Aug 7 11:06:27.165999846 (1h26m26.755344833s) [upload=1506]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:06:27.166004514 (1h26m26.755349501s) [upload=1506]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:06:27.166006879 (1h26m26.755351866s) [upload=1506]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:06:27.461217888 (1h26m27.050562895s) [upload=1506]: Done uploading segments... Aug 7 11:06:27.461244228 (1h26m27.050589235s) [upload=1506]: Upload finished. err: <nil> Aug 7 11:06:51.758067156 (1h26m51.347412153s) [upload=1516]: Starting upload Aug 7 11:06:51.758145406 (1h26m51.347490393s) [upload=1516]: Done starting upload Aug 7 11:06:51.758219668 (1h26m51.347564656s) [upload=1516]: Uploading segments... Aug 7 11:06:51.758268161 (1h26m51.347613179s) [upload=1516]: Got next segment. Inline: true Aug 7 11:06:51.758274043 (1h26m51.34761903s) [upload=1516]: Waiting for error group managing segments... Aug 7 11:06:51.758323187 (1h26m51.347668174s) [upload=1516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:06:51.758328968 (1h26m51.347673955s) [upload=1516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:06:51.758332855 (1h26m51.347677832s) [upload=1516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:06:52.042427305 (1h26m51.631772292s) [upload=1516]: Done uploading segments... Aug 7 11:06:52.042443816 (1h26m51.631788803s) [upload=1516]: Upload finished. err: <nil> Aug 7 11:07:18.108332658 (1h27m17.697677645s) [upload=1523]: Starting upload Aug 7 11:07:18.108389216 (1h27m17.697734203s) [upload=1523]: Done starting upload Aug 7 11:07:18.108445013 (1h27m17.69779s) [upload=1523]: Uploading segments... Aug 7 11:07:18.108475141 (1h27m17.697820128s) [upload=1523]: Got next segment. Inline: true Aug 7 11:07:18.108479218 (1h27m17.697824205s) [upload=1523]: Waiting for error group managing segments... Aug 7 11:07:18.108511189 (1h27m17.697856166s) [upload=1523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:07:18.108514846 (1h27m17.697859833s) [upload=1523]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:07:18.108517130 (1h27m17.697862107s) [upload=1523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:07:18.393523775 (1h27m17.982868772s) [upload=1523]: Done uploading segments... Aug 7 11:07:18.393544465 (1h27m17.982889462s) [upload=1523]: Upload finished. err: <nil> Aug 7 11:07:35.783491476 (1h27m35.372836463s) [upload=1528]: Starting upload Aug 7 11:07:35.783550108 (1h27m35.372895095s) [upload=1528]: Done starting upload Aug 7 11:07:35.783614872 (1h27m35.372959849s) [upload=1528]: Uploading segments... Aug 7 11:07:35.783642465 (1h27m35.372987452s) [upload=1528]: Got next segment. Inline: true Aug 7 11:07:35.783646292 (1h27m35.372991279s) [upload=1528]: Waiting for error group managing segments... Aug 7 11:07:35.783679206 (1h27m35.373024193s) [upload=1528]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:07:35.783683013 (1h27m35.373028s) [upload=1528]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:07:35.783685417 (1h27m35.373030404s) [upload=1528]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:07:36.053267040 (1h27m35.642612027s) [upload=1528]: Done uploading segments... Aug 7 11:07:36.053284914 (1h27m35.642629901s) [upload=1528]: Upload finished. err: <nil> Aug 7 11:08:23.206332742 (1h28m22.795677729s) [upload=1539]: Starting upload Aug 7 11:08:23.206382287 (1h28m22.795727264s) [upload=1539]: Done starting upload Aug 7 11:08:23.206430539 (1h28m22.795775527s) [upload=1539]: Uploading segments... Aug 7 11:08:23.206461519 (1h28m22.795806506s) [upload=1539]: Got next segment. Inline: true Aug 7 11:08:23.206465286 (1h28m22.795810273s) [upload=1539]: Waiting for error group managing segments... Aug 7 11:08:23.206496525 (1h28m22.795841512s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:08:23.206500292 (1h28m22.795845269s) [upload=1539]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:08:23.206502677 (1h28m22.795847664s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:08:23.486896147 (1h28m23.076241124s) [upload=1539]: Done uploading segments... Aug 7 11:08:23.486913369 (1h28m23.076258357s) [upload=1539]: Upload finished. err: <nil> Aug 7 11:09:09.053090663 (1h29m8.64243565s) [upload=1554]: Starting upload Aug 7 11:09:09.053150958 (1h29m8.642495945s) [upload=1554]: Done starting upload Aug 7 11:09:09.053226233 (1h29m8.64257122s) [upload=1554]: Uploading segments... Aug 7 11:09:09.053360289 (1h29m8.642705286s) [upload=1554]: Got next segment. Inline: true Aug 7 11:09:09.053367423 (1h29m8.64271242s) [upload=1554]: Waiting for error group managing segments... Aug 7 11:09:09.053434731 (1h29m8.642779718s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:09.053440492 (1h29m8.642785469s) [upload=1554]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:09.053442827 (1h29m8.642787814s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:09.323042694 (1h29m8.912387681s) [upload=1554]: Done uploading segments... Aug 7 11:09:09.323065918 (1h29m8.912410935s) [upload=1554]: Upload finished. err: <nil> Aug 7 11:09:53.700725757 (1h29m53.290070744s) [upload=1566]: Starting upload Aug 7 11:09:53.700784269 (1h29m53.290129256s) [upload=1566]: Done starting upload Aug 7 11:09:53.700851147 (1h29m53.290196134s) [upload=1566]: Uploading segments... Aug 7 11:09:53.700878068 (1h29m53.290223055s) [upload=1566]: Got next segment. Inline: true Aug 7 11:09:53.700895662 (1h29m53.290240649s) [upload=1566]: Waiting for error group managing segments... Aug 7 11:09:53.700928885 (1h29m53.290273873s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:53.700932592 (1h29m53.29027758s) [upload=1566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:53.700936700 (1h29m53.290281687s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:53.991283642 (1h29m53.58062863s) [upload=1566]: Done uploading segments... Aug 7 11:09:53.991302078 (1h29m53.580647055s) [upload=1566]: Upload finished. err: <nil> Aug 7 11:10:18.597354457 (1h30m18.186699444s) [upload=1573]: Starting upload Aug 7 11:10:18.597413980 (1h30m18.186758957s) [upload=1573]: Done starting upload Aug 7 11:10:18.597467834 (1h30m18.186812821s) [upload=1573]: Uploading segments... Aug 7 11:10:18.597504503 (1h30m18.1868495s) [upload=1573]: Got next segment. Inline: true Aug 7 11:10:18.597509032 (1h30m18.186854019s) [upload=1573]: Waiting for error group managing segments... Aug 7 11:10:18.597548949 (1h30m18.186893936s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:10:18.597554038 (1h30m18.186899025s) [upload=1573]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:10:18.597556844 (1h30m18.186901841s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:10:18.881651073 (1h30m18.47099606s) [upload=1573]: Done uploading segments... Aug 7 11:10:18.881675630 (1h30m18.471020667s) [upload=1573]: Upload finished. err: <nil> Aug 7 11:11:04.334988889 (1h31m3.924333876s) [upload=1585]: Starting upload Aug 7 11:11:04.335046088 (1h31m3.924391075s) [upload=1585]: Done starting upload Aug 7 11:11:04.335116203 (1h31m3.92446119s) [upload=1585]: Uploading segments... Aug 7 11:11:04.335163783 (1h31m3.92450877s) [upload=1585]: Got next segment. Inline: true Aug 7 11:11:04.335167912 (1h31m3.924512899s) [upload=1585]: Waiting for error group managing segments... Aug 7 11:11:04.335205613 (1h31m3.924550591s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:04.335209040 (1h31m3.924554027s) [upload=1585]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:04.335211685 (1h31m3.924556672s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:04.615824694 (1h31m4.205169681s) [upload=1585]: Done uploading segments... Aug 7 11:11:04.615851816 (1h31m4.205196793s) [upload=1585]: Upload finished. err: <nil> Aug 7 11:11:28.808474153 (1h31m28.39781914s) [upload=1593]: Starting upload Aug 7 11:11:28.808518859 (1h31m28.397863846s) [upload=1593]: Done starting upload Aug 7 11:11:28.808565909 (1h31m28.397910896s) [upload=1593]: Uploading segments... Aug 7 11:11:28.808594454 (1h31m28.397939431s) [upload=1593]: Got next segment. Inline: true Aug 7 11:11:28.808598491 (1h31m28.397943478s) [upload=1593]: Waiting for error group managing segments... Aug 7 11:11:28.808629801 (1h31m28.397974778s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:28.808658726 (1h31m28.398003714s) [upload=1593]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:28.808661191 (1h31m28.398006178s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:29.093152140 (1h31m28.682497157s) [upload=1593]: Done uploading segments... Aug 7 11:11:29.093175785 (1h31m28.682520783s) [upload=1593]: Upload finished. err: <nil> Duration: 1.868039848s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X.......X.................................X...............X.] duration: 1.831560493s FAIL (2025-08-07 11:11:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59db762adb475abe8c082c8408e0bb2feec42755abc0e5049e2c34f5ddd5527a != before 9600c6b69f8ccaa28757129ab7e0009fa1fb7d638f9d51876de63bf6a56a36df ======LOGS====== item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:05:32.723956611 (1h25m32.313301598s) [upload=1491]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:05:33.038262414 (1h25m32.627607411s) [upload=1491]: Done uploading segments... Aug 7 11:05:33.038280648 (1h25m32.627625635s) [upload=1491]: Upload finished. err: <nil> Aug 7 11:06:27.165717085 (1h26m26.755062062s) [upload=1506]: Starting upload Aug 7 11:06:27.165764756 (1h26m26.755109743s) [upload=1506]: Done starting upload Aug 7 11:06:27.165859778 (1h26m26.755204765s) [upload=1506]: Uploading segments... Aug 7 11:06:27.165945301 (1h26m26.755290288s) [upload=1506]: Got next segment. Inline: true Aug 7 11:06:27.165949790 (1h26m26.755294777s) [upload=1506]: Waiting for error group managing segments... Aug 7 11:06:27.165999846 (1h26m26.755344833s) [upload=1506]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:06:27.166004514 (1h26m26.755349501s) [upload=1506]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:06:27.166006879 (1h26m26.755351866s) [upload=1506]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:06:27.461217888 (1h26m27.050562895s) [upload=1506]: Done uploading segments... Aug 7 11:06:27.461244228 (1h26m27.050589235s) [upload=1506]: Upload finished. err: <nil> Aug 7 11:06:51.758067156 (1h26m51.347412153s) [upload=1516]: Starting upload Aug 7 11:06:51.758145406 (1h26m51.347490393s) [upload=1516]: Done starting upload Aug 7 11:06:51.758219668 (1h26m51.347564656s) [upload=1516]: Uploading segments... Aug 7 11:06:51.758268161 (1h26m51.347613179s) [upload=1516]: Got next segment. Inline: true Aug 7 11:06:51.758274043 (1h26m51.34761903s) [upload=1516]: Waiting for error group managing segments... Aug 7 11:06:51.758323187 (1h26m51.347668174s) [upload=1516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:06:51.758328968 (1h26m51.347673955s) [upload=1516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:06:51.758332855 (1h26m51.347677832s) [upload=1516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:06:52.042427305 (1h26m51.631772292s) [upload=1516]: Done uploading segments... Aug 7 11:06:52.042443816 (1h26m51.631788803s) [upload=1516]: Upload finished. err: <nil> Aug 7 11:07:18.108332658 (1h27m17.697677645s) [upload=1523]: Starting upload Aug 7 11:07:18.108389216 (1h27m17.697734203s) [upload=1523]: Done starting upload Aug 7 11:07:18.108445013 (1h27m17.69779s) [upload=1523]: Uploading segments... Aug 7 11:07:18.108475141 (1h27m17.697820128s) [upload=1523]: Got next segment. Inline: true Aug 7 11:07:18.108479218 (1h27m17.697824205s) [upload=1523]: Waiting for error group managing segments... Aug 7 11:07:18.108511189 (1h27m17.697856166s) [upload=1523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:07:18.108514846 (1h27m17.697859833s) [upload=1523]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:07:18.108517130 (1h27m17.697862107s) [upload=1523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:07:18.393523775 (1h27m17.982868772s) [upload=1523]: Done uploading segments... Aug 7 11:07:18.393544465 (1h27m17.982889462s) [upload=1523]: Upload finished. err: <nil> Aug 7 11:07:35.783491476 (1h27m35.372836463s) [upload=1528]: Starting upload Aug 7 11:07:35.783550108 (1h27m35.372895095s) [upload=1528]: Done starting upload Aug 7 11:07:35.783614872 (1h27m35.372959849s) [upload=1528]: Uploading segments... Aug 7 11:07:35.783642465 (1h27m35.372987452s) [upload=1528]: Got next segment. Inline: true Aug 7 11:07:35.783646292 (1h27m35.372991279s) [upload=1528]: Waiting for error group managing segments... Aug 7 11:07:35.783679206 (1h27m35.373024193s) [upload=1528]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:07:35.783683013 (1h27m35.373028s) [upload=1528]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:07:35.783685417 (1h27m35.373030404s) [upload=1528]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:07:36.053267040 (1h27m35.642612027s) [upload=1528]: Done uploading segments... Aug 7 11:07:36.053284914 (1h27m35.642629901s) [upload=1528]: Upload finished. err: <nil> Aug 7 11:08:23.206332742 (1h28m22.795677729s) [upload=1539]: Starting upload Aug 7 11:08:23.206382287 (1h28m22.795727264s) [upload=1539]: Done starting upload Aug 7 11:08:23.206430539 (1h28m22.795775527s) [upload=1539]: Uploading segments... Aug 7 11:08:23.206461519 (1h28m22.795806506s) [upload=1539]: Got next segment. Inline: true Aug 7 11:08:23.206465286 (1h28m22.795810273s) [upload=1539]: Waiting for error group managing segments... Aug 7 11:08:23.206496525 (1h28m22.795841512s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:08:23.206500292 (1h28m22.795845269s) [upload=1539]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:08:23.206502677 (1h28m22.795847664s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:08:23.486896147 (1h28m23.076241124s) [upload=1539]: Done uploading segments... Aug 7 11:08:23.486913369 (1h28m23.076258357s) [upload=1539]: Upload finished. err: <nil> Aug 7 11:09:09.053090663 (1h29m8.64243565s) [upload=1554]: Starting upload Aug 7 11:09:09.053150958 (1h29m8.642495945s) [upload=1554]: Done starting upload Aug 7 11:09:09.053226233 (1h29m8.64257122s) [upload=1554]: Uploading segments... Aug 7 11:09:09.053360289 (1h29m8.642705286s) [upload=1554]: Got next segment. Inline: true Aug 7 11:09:09.053367423 (1h29m8.64271242s) [upload=1554]: Waiting for error group managing segments... Aug 7 11:09:09.053434731 (1h29m8.642779718s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:09.053440492 (1h29m8.642785469s) [upload=1554]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:09.053442827 (1h29m8.642787814s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:09.323042694 (1h29m8.912387681s) [upload=1554]: Done uploading segments... Aug 7 11:09:09.323065918 (1h29m8.912410935s) [upload=1554]: Upload finished. err: <nil> Aug 7 11:09:53.700725757 (1h29m53.290070744s) [upload=1566]: Starting upload Aug 7 11:09:53.700784269 (1h29m53.290129256s) [upload=1566]: Done starting upload Aug 7 11:09:53.700851147 (1h29m53.290196134s) [upload=1566]: Uploading segments... Aug 7 11:09:53.700878068 (1h29m53.290223055s) [upload=1566]: Got next segment. Inline: true Aug 7 11:09:53.700895662 (1h29m53.290240649s) [upload=1566]: Waiting for error group managing segments... Aug 7 11:09:53.700928885 (1h29m53.290273873s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:53.700932592 (1h29m53.29027758s) [upload=1566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:53.700936700 (1h29m53.290281687s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:53.991283642 (1h29m53.58062863s) [upload=1566]: Done uploading segments... Aug 7 11:09:53.991302078 (1h29m53.580647055s) [upload=1566]: Upload finished. err: <nil> Aug 7 11:10:18.597354457 (1h30m18.186699444s) [upload=1573]: Starting upload Aug 7 11:10:18.597413980 (1h30m18.186758957s) [upload=1573]: Done starting upload Aug 7 11:10:18.597467834 (1h30m18.186812821s) [upload=1573]: Uploading segments... Aug 7 11:10:18.597504503 (1h30m18.1868495s) [upload=1573]: Got next segment. Inline: true Aug 7 11:10:18.597509032 (1h30m18.186854019s) [upload=1573]: Waiting for error group managing segments... Aug 7 11:10:18.597548949 (1h30m18.186893936s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:10:18.597554038 (1h30m18.186899025s) [upload=1573]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:10:18.597556844 (1h30m18.186901841s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:10:18.881651073 (1h30m18.47099606s) [upload=1573]: Done uploading segments... Aug 7 11:10:18.881675630 (1h30m18.471020667s) [upload=1573]: Upload finished. err: <nil> Aug 7 11:11:04.334988889 (1h31m3.924333876s) [upload=1585]: Starting upload Aug 7 11:11:04.335046088 (1h31m3.924391075s) [upload=1585]: Done starting upload Aug 7 11:11:04.335116203 (1h31m3.92446119s) [upload=1585]: Uploading segments... Aug 7 11:11:04.335163783 (1h31m3.92450877s) [upload=1585]: Got next segment. Inline: true Aug 7 11:11:04.335167912 (1h31m3.924512899s) [upload=1585]: Waiting for error group managing segments... Aug 7 11:11:04.335205613 (1h31m3.924550591s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:04.335209040 (1h31m3.924554027s) [upload=1585]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:04.335211685 (1h31m3.924556672s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:04.615824694 (1h31m4.205169681s) [upload=1585]: Done uploading segments... Aug 7 11:11:04.615851816 (1h31m4.205196793s) [upload=1585]: Upload finished. err: <nil> Aug 7 11:11:28.808474153 (1h31m28.39781914s) [upload=1593]: Starting upload Aug 7 11:11:28.808518859 (1h31m28.397863846s) [upload=1593]: Done starting upload Aug 7 11:11:28.808565909 (1h31m28.397910896s) [upload=1593]: Uploading segments... Aug 7 11:11:28.808594454 (1h31m28.397939431s) [upload=1593]: Got next segment. Inline: true Aug 7 11:11:28.808598491 (1h31m28.397943478s) [upload=1593]: Waiting for error group managing segments... Aug 7 11:11:28.808629801 (1h31m28.397974778s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:28.808658726 (1h31m28.398003714s) [upload=1593]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:28.808661191 (1h31m28.398006178s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:29.093152140 (1h31m28.682497157s) [upload=1593]: Done uploading segments... Aug 7 11:11:29.093175785 (1h31m28.682520783s) [upload=1593]: Upload finished. err: <nil> Duration: 1.83158475s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.................X..X...X........................X.........] duration: 5.669192989s FAIL (2025-08-07 11:11:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.669214841s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X.......X.................................X...............X] duration: 1.625427045s FAIL (2025-08-07 11:11:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 59db762adb475abe8c082c8408e0bb2feec42755abc0e5049e2c34f5ddd5527a != before 9600c6b69f8ccaa28757129ab7e0009fa1fb7d638f9d51876de63bf6a56a36df ======LOGS====== item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:05:32.723956611 (1h25m32.313301598s) [upload=1491]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:05:33.038262414 (1h25m32.627607411s) [upload=1491]: Done uploading segments... Aug 7 11:05:33.038280648 (1h25m32.627625635s) [upload=1491]: Upload finished. err: <nil> Aug 7 11:06:27.165717085 (1h26m26.755062062s) [upload=1506]: Starting upload Aug 7 11:06:27.165764756 (1h26m26.755109743s) [upload=1506]: Done starting upload Aug 7 11:06:27.165859778 (1h26m26.755204765s) [upload=1506]: Uploading segments... Aug 7 11:06:27.165945301 (1h26m26.755290288s) [upload=1506]: Got next segment. Inline: true Aug 7 11:06:27.165949790 (1h26m26.755294777s) [upload=1506]: Waiting for error group managing segments... Aug 7 11:06:27.165999846 (1h26m26.755344833s) [upload=1506]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:06:27.166004514 (1h26m26.755349501s) [upload=1506]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:06:27.166006879 (1h26m26.755351866s) [upload=1506]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:06:27.461217888 (1h26m27.050562895s) [upload=1506]: Done uploading segments... Aug 7 11:06:27.461244228 (1h26m27.050589235s) [upload=1506]: Upload finished. err: <nil> Aug 7 11:06:51.758067156 (1h26m51.347412153s) [upload=1516]: Starting upload Aug 7 11:06:51.758145406 (1h26m51.347490393s) [upload=1516]: Done starting upload Aug 7 11:06:51.758219668 (1h26m51.347564656s) [upload=1516]: Uploading segments... Aug 7 11:06:51.758268161 (1h26m51.347613179s) [upload=1516]: Got next segment. Inline: true Aug 7 11:06:51.758274043 (1h26m51.34761903s) [upload=1516]: Waiting for error group managing segments... Aug 7 11:06:51.758323187 (1h26m51.347668174s) [upload=1516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:06:51.758328968 (1h26m51.347673955s) [upload=1516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:06:51.758332855 (1h26m51.347677832s) [upload=1516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:06:52.042427305 (1h26m51.631772292s) [upload=1516]: Done uploading segments... Aug 7 11:06:52.042443816 (1h26m51.631788803s) [upload=1516]: Upload finished. err: <nil> Aug 7 11:07:18.108332658 (1h27m17.697677645s) [upload=1523]: Starting upload Aug 7 11:07:18.108389216 (1h27m17.697734203s) [upload=1523]: Done starting upload Aug 7 11:07:18.108445013 (1h27m17.69779s) [upload=1523]: Uploading segments... Aug 7 11:07:18.108475141 (1h27m17.697820128s) [upload=1523]: Got next segment. Inline: true Aug 7 11:07:18.108479218 (1h27m17.697824205s) [upload=1523]: Waiting for error group managing segments... Aug 7 11:07:18.108511189 (1h27m17.697856166s) [upload=1523]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:07:18.108514846 (1h27m17.697859833s) [upload=1523]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:07:18.108517130 (1h27m17.697862107s) [upload=1523]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:07:18.393523775 (1h27m17.982868772s) [upload=1523]: Done uploading segments... Aug 7 11:07:18.393544465 (1h27m17.982889462s) [upload=1523]: Upload finished. err: <nil> Aug 7 11:07:35.783491476 (1h27m35.372836463s) [upload=1528]: Starting upload Aug 7 11:07:35.783550108 (1h27m35.372895095s) [upload=1528]: Done starting upload Aug 7 11:07:35.783614872 (1h27m35.372959849s) [upload=1528]: Uploading segments... Aug 7 11:07:35.783642465 (1h27m35.372987452s) [upload=1528]: Got next segment. Inline: true Aug 7 11:07:35.783646292 (1h27m35.372991279s) [upload=1528]: Waiting for error group managing segments... Aug 7 11:07:35.783679206 (1h27m35.373024193s) [upload=1528]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:07:35.783683013 (1h27m35.373028s) [upload=1528]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:07:35.783685417 (1h27m35.373030404s) [upload=1528]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:07:36.053267040 (1h27m35.642612027s) [upload=1528]: Done uploading segments... Aug 7 11:07:36.053284914 (1h27m35.642629901s) [upload=1528]: Upload finished. err: <nil> Aug 7 11:08:23.206332742 (1h28m22.795677729s) [upload=1539]: Starting upload Aug 7 11:08:23.206382287 (1h28m22.795727264s) [upload=1539]: Done starting upload Aug 7 11:08:23.206430539 (1h28m22.795775527s) [upload=1539]: Uploading segments... Aug 7 11:08:23.206461519 (1h28m22.795806506s) [upload=1539]: Got next segment. Inline: true Aug 7 11:08:23.206465286 (1h28m22.795810273s) [upload=1539]: Waiting for error group managing segments... Aug 7 11:08:23.206496525 (1h28m22.795841512s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:08:23.206500292 (1h28m22.795845269s) [upload=1539]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:08:23.206502677 (1h28m22.795847664s) [upload=1539]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:08:23.486896147 (1h28m23.076241124s) [upload=1539]: Done uploading segments... Aug 7 11:08:23.486913369 (1h28m23.076258357s) [upload=1539]: Upload finished. err: <nil> Aug 7 11:09:09.053090663 (1h29m8.64243565s) [upload=1554]: Starting upload Aug 7 11:09:09.053150958 (1h29m8.642495945s) [upload=1554]: Done starting upload Aug 7 11:09:09.053226233 (1h29m8.64257122s) [upload=1554]: Uploading segments... Aug 7 11:09:09.053360289 (1h29m8.642705286s) [upload=1554]: Got next segment. Inline: true Aug 7 11:09:09.053367423 (1h29m8.64271242s) [upload=1554]: Waiting for error group managing segments... Aug 7 11:09:09.053434731 (1h29m8.642779718s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:09.053440492 (1h29m8.642785469s) [upload=1554]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:09.053442827 (1h29m8.642787814s) [upload=1554]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:09.323042694 (1h29m8.912387681s) [upload=1554]: Done uploading segments... Aug 7 11:09:09.323065918 (1h29m8.912410935s) [upload=1554]: Upload finished. err: <nil> Aug 7 11:09:53.700725757 (1h29m53.290070744s) [upload=1566]: Starting upload Aug 7 11:09:53.700784269 (1h29m53.290129256s) [upload=1566]: Done starting upload Aug 7 11:09:53.700851147 (1h29m53.290196134s) [upload=1566]: Uploading segments... Aug 7 11:09:53.700878068 (1h29m53.290223055s) [upload=1566]: Got next segment. Inline: true Aug 7 11:09:53.700895662 (1h29m53.290240649s) [upload=1566]: Waiting for error group managing segments... Aug 7 11:09:53.700928885 (1h29m53.290273873s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:09:53.700932592 (1h29m53.29027758s) [upload=1566]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:09:53.700936700 (1h29m53.290281687s) [upload=1566]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:09:53.991283642 (1h29m53.58062863s) [upload=1566]: Done uploading segments... Aug 7 11:09:53.991302078 (1h29m53.580647055s) [upload=1566]: Upload finished. err: <nil> Aug 7 11:10:18.597354457 (1h30m18.186699444s) [upload=1573]: Starting upload Aug 7 11:10:18.597413980 (1h30m18.186758957s) [upload=1573]: Done starting upload Aug 7 11:10:18.597467834 (1h30m18.186812821s) [upload=1573]: Uploading segments... Aug 7 11:10:18.597504503 (1h30m18.1868495s) [upload=1573]: Got next segment. Inline: true Aug 7 11:10:18.597509032 (1h30m18.186854019s) [upload=1573]: Waiting for error group managing segments... Aug 7 11:10:18.597548949 (1h30m18.186893936s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:10:18.597554038 (1h30m18.186899025s) [upload=1573]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:10:18.597556844 (1h30m18.186901841s) [upload=1573]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:10:18.881651073 (1h30m18.47099606s) [upload=1573]: Done uploading segments... Aug 7 11:10:18.881675630 (1h30m18.471020667s) [upload=1573]: Upload finished. err: <nil> Aug 7 11:11:04.334988889 (1h31m3.924333876s) [upload=1585]: Starting upload Aug 7 11:11:04.335046088 (1h31m3.924391075s) [upload=1585]: Done starting upload Aug 7 11:11:04.335116203 (1h31m3.92446119s) [upload=1585]: Uploading segments... Aug 7 11:11:04.335163783 (1h31m3.92450877s) [upload=1585]: Got next segment. Inline: true Aug 7 11:11:04.335167912 (1h31m3.924512899s) [upload=1585]: Waiting for error group managing segments... Aug 7 11:11:04.335205613 (1h31m3.924550591s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:04.335209040 (1h31m3.924554027s) [upload=1585]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:04.335211685 (1h31m3.924556672s) [upload=1585]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:04.615824694 (1h31m4.205169681s) [upload=1585]: Done uploading segments... Aug 7 11:11:04.615851816 (1h31m4.205196793s) [upload=1585]: Upload finished. err: <nil> Aug 7 11:11:28.808474153 (1h31m28.39781914s) [upload=1593]: Starting upload Aug 7 11:11:28.808518859 (1h31m28.397863846s) [upload=1593]: Done starting upload Aug 7 11:11:28.808565909 (1h31m28.397910896s) [upload=1593]: Uploading segments... Aug 7 11:11:28.808594454 (1h31m28.397939431s) [upload=1593]: Got next segment. Inline: true Aug 7 11:11:28.808598491 (1h31m28.397943478s) [upload=1593]: Waiting for error group managing segments... Aug 7 11:11:28.808629801 (1h31m28.397974778s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:11:28.808658726 (1h31m28.398003714s) [upload=1593]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:11:28.808661191 (1h31m28.398006178s) [upload=1593]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:11:29.093152140 (1h31m28.682497157s) [upload=1593]: Done uploading segments... Aug 7 11:11:29.093175785 (1h31m28.682520783s) [upload=1593]: Upload finished. err: <nil> Duration: 1.625453735s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X.......X.................................X...............] duration: 1.892390508s FAIL (2025-08-07 11:11:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.892416727s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.................X..X...X........................X........] duration: 5.690874189s FAIL (2025-08-07 11:10:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.690898816s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X..X.......X.................................X..............] duration: 1.859822665s FAIL (2025-08-07 11:10:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.859848566s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X..X.......X.................................X.............] duration: 1.86890387s FAIL (2025-08-07 11:09:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.868928458s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X.................X..X...X........................X.......] duration: 5.635941329s FAIL (2025-08-07 11:09:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.635975974s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X..X.......X.................................X............] duration: 1.834706712s FAIL (2025-08-07 11:09:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.834766747s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X..X.......X.................................X...........] duration: 1.85858166s FAIL (2025-08-07 11:08:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.85860809s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X.................X..X...X........................X......] duration: 6.045568716s FAIL (2025-08-07 11:08:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 6.045595027s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X..X.......X.................................X..........] duration: 1.829174607s FAIL (2025-08-07 11:07:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.82919713s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X..X.......X.................................X.........] duration: 1.891332454s FAIL (2025-08-07 11:07:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.891353434s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X.................X..X...X........................X.....] duration: 5.618441795s FAIL (2025-08-07 11:07:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.618459389s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X.................X..X...X........................X....] duration: 5.857486895s FAIL (2025-08-07 11:06:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.857511521s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X..X.......X.................................X........] duration: 1.864376129s FAIL (2025-08-07 11:06:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.86439181s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X..X.......X.................................X.......] duration: 1.904361151s FAIL (2025-08-07 11:06:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.904378784s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X.................X..X...X........................X...] duration: 5.766023019s FAIL (2025-08-07 11:05:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.766053767s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X..X.......X.................................X......] duration: 1.90550028s FAIL (2025-08-07 11:05:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.905526681s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X.................X..X...X........................X..] duration: 5.713855749s FAIL (2025-08-07 11:05:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.7139348s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X.................X..X...X........................X.] duration: 5.652297171s FAIL (2025-08-07 11:05:07 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 5.652322279s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........X..X.......X.................................X.....] duration: 1.842687985s FAIL (2025-08-07 11:04:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.842729795s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........X.................X..X...X........................X] duration: 4.005274537s FAIL (2025-08-07 11:04:17 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 6s) [upload=1444]: Done uploading segments... Aug 7 11:03:05.619280789 (1h23m5.208625797s) [upload=1444]: Upload finished. err: <nil> Aug 7 11:04:14.019598941 (1h24m13.608943919s) [upload=1466]: Starting upload Aug 7 11:04:14.019641232 (1h24m13.608986219s) [upload=1466]: Done starting upload Aug 7 11:04:14.019911930 (1h24m13.609256917s) [upload=1466]: Uploading segments... Aug 7 11:04:14.019944562 (1h24m13.609289539s) [upload=1466]: Got next segment. Inline: false Aug 7 11:04:14.019971293 (1h24m13.60931628s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:04:14.019975631 (1h24m13.609320619s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 11:04:14.466548257 (1h24m14.055893244s) [seg_pos={0 0}, upload=1466]: Begin upload segment... Aug 7 11:04:14.466631356 (1h24m14.055976343s) [seg_pos={0 0}, upload=1466]: Done begin upload segment. Aug 7 11:04:14.466657816 (1h24m14.056002803s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.466665881 (1h24m14.056010868s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467023295 (1h24m14.056368272s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467029407 (1h24m14.056374394s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467299624 (1h24m14.056644611s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467318440 (1h24m14.056663427s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467561404 (1h24m14.056906381s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467587434 (1h24m14.056932421s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467877399 (1h24m14.057222386s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.467940259 (1h24m14.057285286s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468107479 (1h24m14.057452466s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468197612 (1h24m14.057542589s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468318413 (1h24m14.05766339s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468463611 (1h24m14.057808598s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468525759 (1h24m14.057870746s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.468740771 (1h24m14.058085758s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.469050324 (1h24m14.058395311s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:14.470041039 (1h24m14.059386026s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Uploading piece... Aug 7 11:04:15.609470628 (1h24m15.198815615s) [upload=1466]: Next returned nil segment Aug 7 11:04:15.609487259 (1h24m15.198832246s) [upload=1466]: Waiting for error group managing segments... Aug 7 11:04:15.914743998 (1h24m15.504088985s) [noise=true , address=64.49.13.138:4491 , piece_id=65R5UGQV26O62VX5PKILPT7LYW4KAKI7PUO3B4V4LWPUZFKQ62JQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.922602884 (1h24m15.511947871s) [noise=true , address=64.49.13.169:4715 , piece_id=EXWIDZRWJCHVA5MAWJQF67MVZM4QJPRCSHT5A5RNTDSUXI73UAZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:15.925407921 (1h24m15.514752908s) [noise=true , address=64.49.13.170:4722 , piece_id=SKNUNNQHZI2KU66IRDSBDR4UINXGQOO275T2SGVGOYY6CPXRBYQA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.386659260 (1h24m15.976004247s) [noise=true , address=104.36.82.47:4521 , piece_id=NS7AYKUW7MYOCDZZLP2HZ7NPBX6VLNTAYO2AGJT3HH6XJKNFHAFA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.390643012 (1h24m15.979988s) [noise=true , address=104.36.82.23:4469 , piece_id=I4R6IAFSV7I4ZVZPBIPZJF5ONS4YXFJESRA5TGA6QQ2ROIQLA2GQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.405265248 (1h24m15.994610235s) [noise=true , address=104.36.82.16:4305 , piece_id=A5WOMMEY63JCVVMXILBGIKTQRZPUA265ZKZYOCFBUZGIXGLS5MYQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.413081123 (1h24m16.00242611s) [noise=true , address=104.36.82.61:4402 , piece_id=CQSRQFKHHVEJPEZSSWOUWVOPMGNQ66W5VVUZEATTIIMBDHK3GPKA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.461145944 (1h24m16.050490941s) [noise=true , address=104.36.82.16:4317 , piece_id=CZWJZMMSCII3BAVXDUGE752AWVNPR63GI762DE4C2J42VT6EYZVA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.471546403 (1h24m16.06089139s) [noise=true , address=104.36.82.9:4012 , piece_id=DOXPF5BF26TPOL2BCVW6RAXO5PH3OURABK6HMMXUKUWPVXJI56AA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.483329326 (1h24m16.072674313s) [noise=true , address=104.36.82.59:4316 , piece_id=47MDOYE3WFCI2PJRNG4PV3MYXSV6U6EF5NI4JXZ6NJL4GAEDUDNA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.491590022 (1h24m16.080935009s) [noise=true , address=104.36.82.14:4249 , piece_id=U3QYNALJ36TFSW526HZW2BKBPEVFV4KSZXSQQVYFZW25RNUWZGZA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.494199674 (1h24m16.083544651s) [noise=true , address=104.36.82.44:4871 , piece_id=U63J45PC5P5SW6UYKBYEHFCBQAR3JSHP2VRYKXGZW6JPGVJMA56Q, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.533728945 (1h24m16.123073932s) [noise=true , address=104.36.82.3:4785 , piece_id=K5ZQHHA5B6VOQEJP3FTLWXF5FTEXYLKGEQVB77NXXHY22OGL35TA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554520033 (1h24m16.14386502s) [noise=true , address=104.36.82.58:4273 , piece_id=I5KEQPFFPTVBDNDYDB5POGSQESUN4JYIP32WNG7MO4YVSZB2XWIA, seg_pos={0 0}, upload=1466]: Done uploading piece. err: <nil> Aug 7 11:04:16.554545913 (1h24m16.1438909s) [seg_pos={0 0}, upload=1466]: Segment reached optimal threshold of 14 pieces. Aug 7 11:04:16.554661665 (1h24m16.144006652s) [noise=true , address=104.36.82.46:4487 , piece_id=MBSONSDHYMSHYITJ5EGXW4U5MVONJS5EU3VZZXJ4TWNQJZCX5NTQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AdZLDV7UBbV2DimCHzmoNxycLigvLMx6Fy9U9QB35WTtiV1KX): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554727601 (1h24m16.144072588s) [noise=true , address=104.36.82.39:4759 , piece_id=LPXLU57HKIS4CU7ZCPI64MABJ6SB5J3MNXWADKWKOYMHCRSDYXAQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AEfTC9phpBk8uTbN6k7oDvz6svgwdPH1PaU8jfuuBxhHTRtTR): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554772587 (1h24m16.144117574s) [noise=true , address=104.36.82.60:4368 , piece_id=SYLPV2SX2G5CWXOBMBT36MNL7UQZPQ5AMKIBVO3WCU47R2XERSCQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554819486 (1h24m16.144164474s) [noise=true , address=104.36.82.55:4194 , piece_id=ELQ2D7GW6B6MMEZWNJKG4YPDTET7MGE3DL2MT7UNXNWOAMRZSSBQ, seg_pos={0 0}, upload=1466]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kta1F6RNDP9GJdkiUG3x1Nk6juWJ2tmSDr599DYomSq9C1BBh): protocol: expected piece hash; context canceled; EOF Aug 7 11:04:16.554842701 (1h24m16.144187688s) [seg_pos={0 0}, upload=1466]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 11:04:16.554902445 (1h24m16.144247432s) [upload=1466]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 11:04:16.554907014 (1h24m16.144251991s) [upload=1466]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:04:16.931956593 (1h24m16.52130158s) [upload=1466]: Done uploading segments... Aug 7 11:04:16.931975309 (1h24m16.521320296s) [upload=1466]: Upload finished. err: <nil> Duration: 4.005310636s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X..X.......X.................................X....] duration: 1.889393243s FAIL (2025-08-07 11:03:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.889418731s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........X..X.......X.................................X...] duration: 1.912271375s FAIL (2025-08-07 11:03:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.912298828s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X.................X..X...X........................] duration: 5.735118822s FAIL (2025-08-07 11:03:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.73514416s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X.................X..X...X.......................] duration: 5.660575059s FAIL (2025-08-07 11:02:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.660600549s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X..X.......X.................................X..] duration: 1.818969713s FAIL (2025-08-07 11:02:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.818997627s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............X..X.......X.................................X.] duration: 1.952045283s FAIL (2025-08-07 11:01:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.952068658s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X.................X..X...X......................] duration: 6.316839601s FAIL (2025-08-07 11:01:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 6.316859619s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X..X.......X.................................X] duration: 853.133725ms FAIL (2025-08-07 11:00:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 7 10:53:24.722205452 (1h13m24.311550439s) [upload=1279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:24.983738245 (1h13m24.573083232s) [upload=1279]: Done uploading segments... Aug 7 10:53:24.983756940 (1h13m24.573101927s) [upload=1279]: Upload finished. err: <nil> Aug 7 10:53:43.934178532 (1h13m43.523523519s) [upload=1286]: Starting upload Aug 7 10:53:43.934221624 (1h13m43.523566611s) [upload=1286]: Done starting upload Aug 7 10:53:43.934269095 (1h13m43.523614082s) [upload=1286]: Uploading segments... Aug 7 10:53:43.934333137 (1h13m43.523678124s) [upload=1286]: Got next segment. Inline: true Aug 7 10:53:43.934337916 (1h13m43.523682903s) [upload=1286]: Waiting for error group managing segments... Aug 7 10:53:43.934372333 (1h13m43.52371732s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:53:43.934376771 (1h13m43.523721758s) [upload=1286]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:53:43.934379176 (1h13m43.523724163s) [upload=1286]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:53:44.424450926 (1h13m44.013795913s) [upload=1286]: Done uploading segments... Aug 7 10:53:44.424462128 (1h13m44.013807115s) [upload=1286]: Upload finished. err: <nil> Aug 7 10:54:28.041918137 (1h14m27.631263124s) [upload=1294]: Starting upload Aug 7 10:54:28.041962793 (1h14m27.63130777s) [upload=1294]: Done starting upload Aug 7 10:54:28.042009091 (1h14m27.631354078s) [upload=1294]: Uploading segments... Aug 7 10:54:28.042038838 (1h14m27.631383825s) [upload=1294]: Got next segment. Inline: true Aug 7 10:54:28.042043067 (1h14m27.631388054s) [upload=1294]: Waiting for error group managing segments... Aug 7 10:54:28.042076060 (1h14m27.631421047s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:54:28.042079536 (1h14m27.631424523s) [upload=1294]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:54:28.042081911 (1h14m27.631426888s) [upload=1294]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:54:28.321953292 (1h14m27.911298279s) [upload=1294]: Done uploading segments... Aug 7 10:54:28.321971346 (1h14m27.911316333s) [upload=1294]: Upload finished. err: <nil> Aug 7 10:55:09.644927912 (1h15m9.234272909s) [upload=1308]: Starting upload Aug 7 10:55:09.644976745 (1h15m9.234321732s) [upload=1308]: Done starting upload Aug 7 10:55:09.645025900 (1h15m9.234370887s) [upload=1308]: Uploading segments... Aug 7 10:55:09.645055155 (1h15m9.234400143s) [upload=1308]: Got next segment. Inline: true Aug 7 10:55:09.645059133 (1h15m9.23440411s) [upload=1308]: Waiting for error group managing segments... Aug 7 10:55:09.645093168 (1h15m9.234438145s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:09.645097165 (1h15m9.234442142s) [upload=1308]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:09.645099450 (1h15m9.234444427s) [upload=1308]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:09.926338236 (1h15m9.515683213s) [upload=1308]: Done uploading segments... Aug 7 10:55:09.926352694 (1h15m9.515697681s) [upload=1308]: Upload finished. err: <nil> Aug 7 10:55:27.476534363 (1h15m27.06587935s) [upload=1316]: Starting upload Aug 7 10:55:27.476615438 (1h15m27.065960456s) [upload=1316]: Done starting upload Aug 7 10:55:27.476682897 (1h15m27.066027904s) [upload=1316]: Uploading segments... Aug 7 10:55:27.476740838 (1h15m27.066085855s) [upload=1316]: Got next segment. Inline: true Aug 7 10:55:27.476749315 (1h15m27.066094322s) [upload=1316]: Waiting for error group managing segments... Aug 7 10:55:27.476799911 (1h15m27.066144918s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:27.476806775 (1h15m27.066151792s) [upload=1316]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:27.476811704 (1h15m27.066156721s) [upload=1316]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:27.786409188 (1h15m27.375754165s) [upload=1316]: Done uploading segments... Aug 7 10:55:27.786428796 (1h15m27.375773783s) [upload=1316]: Upload finished. err: <nil> Aug 7 10:55:50.337831598 (1h15m49.927176585s) [upload=1322]: Starting upload Aug 7 10:55:50.337883897 (1h15m49.927228884s) [upload=1322]: Done starting upload Aug 7 10:55:50.337940447 (1h15m49.927285424s) [upload=1322]: Uploading segments... Aug 7 10:55:50.337973890 (1h15m49.927318877s) [upload=1322]: Got next segment. Inline: true Aug 7 10:55:50.337977287 (1h15m49.927322274s) [upload=1322]: Waiting for error group managing segments... Aug 7 10:55:50.338032132 (1h15m49.927377119s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:55:50.338036350 (1h15m49.927381327s) [upload=1322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:55:50.338038504 (1h15m49.927383481s) [upload=1322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:55:50.610838845 (1h15m50.200183832s) [upload=1322]: Done uploading segments... Aug 7 10:55:50.610857440 (1h15m50.200202427s) [upload=1322]: Upload finished. err: <nil> Aug 7 10:56:54.734042484 (1h16m54.323387461s) [upload=1338]: Starting upload Aug 7 10:56:54.734086599 (1h16m54.323431586s) [upload=1338]: Done starting upload Aug 7 10:56:54.734133449 (1h16m54.323478426s) [upload=1338]: Uploading segments... Aug 7 10:56:54.734164568 (1h16m54.323509555s) [upload=1338]: Got next segment. Inline: true Aug 7 10:56:54.734168576 (1h16m54.323513563s) [upload=1338]: Waiting for error group managing segments... Aug 7 10:56:54.734201859 (1h16m54.323546846s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:56:54.734205736 (1h16m54.323550723s) [upload=1338]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:56:54.734208071 (1h16m54.323553058s) [upload=1338]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:56:55.016438714 (1h16m54.605783701s) [upload=1338]: Done uploading segments... Aug 7 10:56:55.016458853 (1h16m54.60580385s) [upload=1338]: Upload finished. err: <nil> Aug 7 10:57:52.925309010 (1h17m52.514653997s) [upload=1353]: Starting upload Aug 7 10:57:52.925348044 (1h17m52.514693031s) [upload=1353]: Done starting upload Aug 7 10:57:52.925395164 (1h17m52.514740151s) [upload=1353]: Uploading segments... Aug 7 10:57:52.925425873 (1h17m52.51477086s) [upload=1353]: Got next segment. Inline: true Aug 7 10:57:52.925429329 (1h17m52.514774317s) [upload=1353]: Waiting for error group managing segments... Aug 7 10:57:52.925459968 (1h17m52.514804945s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:57:52.925463344 (1h17m52.514808331s) [upload=1353]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:57:52.925465499 (1h17m52.514810486s) [upload=1353]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:57:53.229374890 (1h17m52.818719878s) [upload=1353]: Done uploading segments... Aug 7 10:57:53.229390761 (1h17m52.818735748s) [upload=1353]: Upload finished. err: <nil> Aug 7 10:58:45.158447925 (1h18m44.747792902s) [upload=1369]: Starting upload Aug 7 10:58:45.158484726 (1h18m44.747829713s) [upload=1369]: Done starting upload Aug 7 10:58:45.158533629 (1h18m44.747878616s) [upload=1369]: Uploading segments... Aug 7 10:58:45.158564388 (1h18m44.747909365s) [upload=1369]: Got next segment. Inline: true Aug 7 10:58:45.158568496 (1h18m44.747913483s) [upload=1369]: Waiting for error group managing segments... Aug 7 10:58:45.158606288 (1h18m44.747951275s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:58:45.158610416 (1h18m44.747955403s) [upload=1369]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:58:45.158613351 (1h18m44.747958328s) [upload=1369]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:58:45.437616129 (1h18m45.026961116s) [upload=1369]: Done uploading segments... Aug 7 10:58:45.437633583 (1h18m45.02697856s) [upload=1369]: Upload finished. err: <nil> Aug 7 10:59:49.192176061 (1h19m48.781521048s) [upload=1391]: Starting upload Aug 7 10:59:49.192242177 (1h19m48.781587164s) [upload=1391]: Done starting upload Aug 7 10:59:49.192308835 (1h19m48.781653862s) [upload=1391]: Uploading segments... Aug 7 10:59:49.192393938 (1h19m48.781738925s) [upload=1391]: Got next segment. Inline: true Aug 7 10:59:49.192400430 (1h19m48.781745417s) [upload=1391]: Waiting for error group managing segments... Aug 7 10:59:49.192836655 (1h19m48.782181652s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:59:49.192843157 (1h19m48.782188184s) [upload=1391]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:59:49.192849339 (1h19m48.782194326s) [upload=1391]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:59:49.457185295 (1h19m49.046530282s) [upload=1391]: Done uploading segments... Aug 7 10:59:49.457201396 (1h19m49.046546383s) [upload=1391]: Upload finished. err: <nil> Aug 7 11:00:49.131084948 (1h20m48.720429935s) [upload=1408]: Starting upload Aug 7 11:00:49.131132077 (1h20m48.720477064s) [upload=1408]: Done starting upload Aug 7 11:00:49.131181732 (1h20m48.720526719s) [upload=1408]: Uploading segments... Aug 7 11:00:49.131212230 (1h20m48.720557218s) [upload=1408]: Got next segment. Inline: true Aug 7 11:00:49.131215817 (1h20m48.720560804s) [upload=1408]: Waiting for error group managing segments... Aug 7 11:00:49.131246787 (1h20m48.720591774s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 11:00:49.131250725 (1h20m48.720595712s) [upload=1408]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 11:00:49.131253119 (1h20m48.720598096s) [upload=1408]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 11:00:49.342873997 (1h20m48.932218984s) [upload=1408]: Done uploading segments... Aug 7 11:00:49.342896210 (1h20m48.932241197s) [upload=1408]: Upload finished. err: metaclient: Too Many Requests Duration:* 853.149676ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X.................X..X...X.....................] duration: 5.701596683s FAIL (2025-08-07 11:00:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.701625076s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X.................X..X...X....................] duration: 5.835713067s FAIL (2025-08-07 10:59:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== oad segment... Aug 7 10:46:00.639518048 (1h6m0.228863025s) [seg_pos={0 0}, upload=1147]: Done begin upload segment. Aug 7 10:46:00.639534009 (1h6m0.228878986s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639543287 (1h6m0.228888274s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639587101 (1h6m0.228932088s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639880683 (1h6m0.22922567s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.639888307 (1h6m0.229233294s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640184364 (1h6m0.229529351s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640469008 (1h6m0.229813985s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.640752731 (1h6m0.230097708s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641048116 (1h6m0.230393113s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641299878 (1h6m0.230644865s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641540128 (1h6m0.230885115s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.641781830 (1h6m0.231126817s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642041126 (1h6m0.231386113s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.642272899 (1h6m0.231617886s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643108358 (1h6m0.232453345s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.643847362 (1h6m0.233192349s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644207381 (1h6m0.233552368s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:00.644487957 (1h6m0.233832945s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Uploading piece... Aug 7 10:46:01.750956143 (1h6m1.34030114s) [upload=1147]: Next returned nil segment Aug 7 10:46:01.750975911 (1h6m1.340320898s) [upload=1147]: Waiting for error group managing segments... Aug 7 10:46:02.059241477 (1h6m1.648586464s) [noise=true , address=64.49.13.154:4926 , piece_id=E4YINKTWDSGX7LBFXXNS4H35HFXMUCN3RLZGZIJGRF62WWTTEC3Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.110861821 (1h6m1.700206808s) [noise=true , address=64.49.13.169:4715 , piece_id=O6WBZJLEZDEXCCJLIEWGPY3KNPXV2XH7EBM5QL7XEN7ZLFX5MU5A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.554791949 (1h6m2.144136936s) [noise=true , address=104.36.82.46:4513 , piece_id=EZVJNEOYHVH5HO6NN5I3OUL3MIWZC4SPFFYRHMD4JAB6JWRD6NFQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.568243235 (1h6m2.157588212s) [noise=true , address=45.91.116.13:4168 , piece_id=5RV35XANSDULOIPTH4ALVVHCEFRLLVWBBGMRLPYPPKPVAPHKCLEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.572530237 (1h6m2.161875215s) [noise=true , address=104.36.82.2:4735 , piece_id=KXVS5BHWVPHLSPVF66CHUCAZZR5ER6DGUP3AILH67X6MLIUT7VRA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.576258630 (1h6m2.165603617s) [noise=true , address=104.36.82.45:4935 , piece_id=QRP53CR3U2OHBRGS5Z32JS62JUYF5C2OGJQGUMSOZIB2TCEUNOFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.579565728 (1h6m2.168910715s) [noise=true , address=104.36.82.55:4207 , piece_id=ZDCLHEJVQPL2ANWWN5HYFVBGZDLW3J734CO5JKODLUYBUCIS6TDQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.608573658 (1h6m2.197918645s) [noise=true , address=104.36.82.12:4171 , piece_id=NRYR2DBD6W6QBEJ6DVYMRFFH3NWHP6X2SA5W5RY2HE4VAOB4MXTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.611840558 (1h6m2.201185545s) [noise=true , address=45.91.116.10:4092 , piece_id=HAQF3A74BPOXVMCMZ7ZHFHYQRBRJOE7JLRFQPADB4GYIN6DOK32Q, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.641328597 (1h6m2.230673584s) [noise=true , address=104.36.82.62:4421 , piece_id=6RL5X35GGDXXTTIP62UIYK5AMB7M3ANIYSGRSZEA3NOA6K7VWOAQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.648162011 (1h6m2.237506998s) [noise=true , address=104.36.82.44:4896 , piece_id=TX4YRG654UGIHJRF7YZ2DCEUTZCC3SABZZULS4CMU65HGABEBGWA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.649978987 (1h6m2.239323975s) [noise=true , address=45.91.116.9:4286 , piece_id=O6VXJUZRAMQAD5SFXWPS2F2WPXXFRCGKLDZNKPOAPHY7U26BDRUA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.650417066 (1h6m2.239762053s) [noise=true , address=104.36.82.60:4343 , piece_id=IFDGQN7CTII7UIXGOEN3OKPVBNPULLFJ4IU5SXL7Z7OMI2MSOGFA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660125781 (1h6m2.249470768s) [noise=true , address=104.36.82.5:4859 , piece_id=4YOOITNIVZ3CSS2V2XVU7LAGNAPNJVXQSCXYM4MRGLWYGQCETSLA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: <nil> Aug 7 10:46:02.660160127 (1h6m2.249505114s) [seg_pos={0 0}, upload=1147]: Segment reached optimal threshold of 14 pieces. Aug 7 10:46:02.660293272 (1h6m2.249638259s) [noise=true , address=45.91.116.11:4138 , piece_id=URWLIOGOJYA2BV6VBIK6ITORT6AIOHDFSCXAXEOE2T5O7IEAV3OQ, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rQNEmGLtqhxcDAeFocRDsfkr5oZMkbLVhmumwb5BKkreNiDPU): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660352084 (1h6m2.249697081s) [noise=true , address=104.36.82.61:4374 , piece_id=RU3MUCDEWNCPREOXHWICYP2GZGHLDY24VBH6SAB7HSHSVSKKWJTA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QRixhWaUwXPdjcWKYHbiknME5JVomWYABY6egDD6VKwaTPB8K): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660388744 (1h6m2.249733731s) [noise=true , address=104.36.82.59:4336 , piece_id=OU5I7TLWX26YQW5KCLXKHY2NYKVK34H5VCVVTVXHVC2D6XEGKBEA, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660449550 (1h6m2.249794527s) [noise=true , address=104.36.82.59:4309 , piece_id=RUWSTNFZOGQUOYUSRCPXVD327Q2AEADDG6V3N7TGZTZQWTIAZ75A, seg_pos={0 0}, upload=1147]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12txGN8RDcyMycMhkRtdZAUkMK9L2ZnqPihEGZ2YNXJvu89RUU1): protocol: expected piece hash; context canceled; EOF Aug 7 10:46:02.660466353 (1h6m2.24981134s) [seg_pos={0 0}, upload=1147]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 10:46:02.660617822 (1h6m2.249962809s) [upload=1147]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 10:46:02.660627110 (1h6m2.249972117s) [upload=1147]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:46:02.973744789 (1h6m2.563089776s) [upload=1147]: Done uploading segments... Aug 7 10:46:02.973770328 (1h6m2.563115315s) [upload=1147]: Upload finished. err: <nil> Aug 7 10:46:26.074219669 (1h6m25.663564656s) [upload=1155]: Starting upload Aug 7 10:46:26.074267260 (1h6m25.663612247s) [upload=1155]: Done starting upload Aug 7 10:46:26.074391487 (1h6m25.663736474s) [upload=1155]: Uploading segments... Aug 7 10:46:26.074498933 (1h6m25.66384392s) [upload=1155]: Got next segment. Inline: false Aug 7 10:46:26.074539941 (1h6m25.663884928s) [upload=1155]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:46:26.074544210 (1h6m25.663889197s) [upload=1155]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 10:46:26.287689865 (1h6m25.877034852s) [upload=1155]: Next segment err: metaclient: Too Many Requests Aug 7 10:46:26.287712548 (1h6m25.877057535s) [upload=1155]: Done uploading segments... Aug 7 10:46:26.287726846 (1h6m25.877071833s) [upload=1155]: Upload finished. err: metaclient: Too Many Requests Duration: 5.835744618s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X..X.......X.................................] duration: 1.832193406s FAIL (2025-08-07 10:59:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7a44b30138608a55d6cfd065ffb70443f816708cd440845caa490ac5768ed710 != before 894d2210894a6651440d4c643e703a73684bb979653e58a69c90556bc2407fe6 ======LOGS====== ine: true Aug 7 10:24:59.349984721 (44m58.939329758s) [upload=777]: Waiting for error group managing segments... Aug 7 10:24:59.350047252 (44m58.939392239s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:24:59.350052742 (44m58.939397729s) [upload=777]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:24:59.350055146 (44m58.939400133s) [upload=777]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:24:59.675076812 (44m59.264421799s) [upload=777]: Done uploading segments... Aug 7 10:24:59.675095087 (44m59.264440074s) [upload=777]: Upload finished. err: <nil> Aug 7 10:26:03.759161199 (46m3.348506186s) [upload=797]: Starting upload Aug 7 10:26:03.759220954 (46m3.348565941s) [upload=797]: Done starting upload Aug 7 10:26:03.759281770 (46m3.348626757s) [upload=797]: Uploading segments... Aug 7 10:26:03.759320204 (46m3.348665191s) [upload=797]: Got next segment. Inline: true Aug 7 10:26:03.759328870 (46m3.348673887s) [upload=797]: Waiting for error group managing segments... Aug 7 10:26:03.759379106 (46m3.348724093s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:03.759384907 (46m3.348729894s) [upload=797]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:03.759388073 (46m3.34873306s) [upload=797]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:04.223095630 (46m3.812440617s) [upload=797]: Done uploading segments... Aug 7 10:26:04.223116940 (46m3.812461927s) [upload=797]: Upload finished. err: <nil> Aug 7 10:26:46.121045367 (46m45.710390354s) [upload=810]: Starting upload Aug 7 10:26:46.121097887 (46m45.710442874s) [upload=810]: Done starting upload Aug 7 10:26:46.121153704 (46m45.710498691s) [upload=810]: Uploading segments... Aug 7 10:26:46.121185846 (46m45.710530834s) [upload=810]: Got next segment. Inline: true Aug 7 10:26:46.121189624 (46m45.710534611s) [upload=810]: Waiting for error group managing segments... Aug 7 10:26:46.121225131 (46m45.710570108s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:26:46.121229139 (46m45.710574126s) [upload=810]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:26:46.121231473 (46m45.71057646s) [upload=810]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:26:46.686932633 (46m46.27627761s) [upload=810]: Done uploading segments... Aug 7 10:26:46.686949556 (46m46.276294543s) [upload=810]: Upload finished. err: <nil> Aug 7 10:27:51.292721044 (47m50.882066051s) [upload=825]: Starting upload Aug 7 10:27:51.292821466 (47m50.882166483s) [upload=825]: Done starting upload Aug 7 10:27:51.292905677 (47m50.882250664s) [upload=825]: Uploading segments... Aug 7 10:27:51.292942277 (47m50.882287264s) [upload=825]: Got next segment. Inline: true Aug 7 10:27:51.292946154 (47m50.882291141s) [upload=825]: Waiting for error group managing segments... Aug 7 10:27:51.292981583 (47m50.88232657s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:27:51.292986221 (47m50.882331208s) [upload=825]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:27:51.292988626 (47m50.882333613s) [upload=825]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:27:51.725430706 (47m51.314775693s) [upload=825]: Done uploading segments... Aug 7 10:27:51.725447788 (47m51.314792765s) [upload=825]: Upload finished. err: <nil> Aug 7 10:28:54.891103407 (48m54.480448394s) [upload=843]: Starting upload Aug 7 10:28:54.891150698 (48m54.480495685s) [upload=843]: Done starting upload Aug 7 10:28:54.891204651 (48m54.480549638s) [upload=843]: Uploading segments... Aug 7 10:28:54.891241070 (48m54.480586057s) [upload=843]: Got next segment. Inline: true Aug 7 10:28:54.891245058 (48m54.480590045s) [upload=843]: Waiting for error group managing segments... Aug 7 10:28:54.891281106 (48m54.480626083s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:28:54.891284985 (48m54.480629972s) [upload=843]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:28:54.891287359 (48m54.480632346s) [upload=843]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:28:55.638240765 (48m55.227585752s) [upload=843]: Done uploading segments... Aug 7 10:28:55.638258239 (48m55.227603226s) [upload=843]: Upload finished. err: <nil> Aug 7 10:29:57.012254009 (49m56.601599027s) [upload=865]: Starting upload Aug 7 10:29:57.012338813 (49m56.6016838s) [upload=865]: Done starting upload Aug 7 10:29:57.012415488 (49m56.601760486s) [upload=865]: Uploading segments... Aug 7 10:29:57.012461517 (49m56.601806534s) [upload=865]: Got next segment. Inline: true Aug 7 10:29:57.012468199 (49m56.601813186s) [upload=865]: Waiting for error group managing segments... Aug 7 10:29:57.012522754 (49m56.601867791s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:29:57.012529426 (49m56.601874423s) [upload=865]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:29:57.012533896 (49m56.601878933s) [upload=865]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:29:57.408039966 (49m56.997384954s) [upload=865]: Done uploading segments... Aug 7 10:29:57.408056187 (49m56.997401174s) [upload=865]: Upload finished. err: <nil> Aug 7 10:30:58.985456964 (50m58.574801941s) [upload=877]: Starting upload Aug 7 10:30:58.985527901 (50m58.574872978s) [upload=877]: Done starting upload Aug 7 10:30:58.985610188 (50m58.574955215s) [upload=877]: Uploading segments... Aug 7 10:30:58.985657639 (50m58.575002656s) [upload=877]: Got next segment. Inline: true Aug 7 10:30:58.985664823 (50m58.57500984s) [upload=877]: Waiting for error group managing segments... Aug 7 10:30:58.985724446 (50m58.575069464s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:30:58.985733533 (50m58.575078521s) [upload=877]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:30:58.985738322 (50m58.57508336s) [upload=877]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:30:59.278811000 (50m58.868155987s) [upload=877]: Done uploading segments... Aug 7 10:30:59.278827111 (50m58.868172098s) [upload=877]: Upload finished. err: <nil> Aug 7 10:32:11.249714437 (52m10.839059435s) [upload=899]: Starting upload Aug 7 10:32:11.249782007 (52m10.839127054s) [upload=899]: Done starting upload Aug 7 10:32:11.249894452 (52m10.839239439s) [upload=899]: Uploading segments... Aug 7 10:32:11.249986508 (52m10.839331495s) [upload=899]: Got next segment. Inline: true Aug 7 10:32:11.249992890 (52m10.839337887s) [upload=899]: Waiting for error group managing segments... Aug 7 10:32:11.250059438 (52m10.839404435s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:11.250065279 (52m10.839410266s) [upload=899]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:11.250068405 (52m10.839413392s) [upload=899]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:11.532409130 (52m11.121754117s) [upload=899]: Done uploading segments... Aug 7 10:32:11.532431152 (52m11.121776139s) [upload=899]: Upload finished. err: <nil> Aug 7 10:32:42.960585814 (52m42.549930801s) [upload=910]: Starting upload Aug 7 10:32:42.960635920 (52m42.549980907s) [upload=910]: Done starting upload Aug 7 10:32:42.960686858 (52m42.550031845s) [upload=910]: Uploading segments... Aug 7 10:32:42.960731562 (52m42.55007657s) [upload=910]: Got next segment. Inline: true Aug 7 10:32:42.960738627 (52m42.550083614s) [upload=910]: Waiting for error group managing segments... Aug 7 10:32:42.960791107 (52m42.550136094s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:32:42.960795776 (52m42.550140763s) [upload=910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:32:42.960799543 (52m42.55014453s) [upload=910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:32:43.296309634 (52m42.885654621s) [upload=910]: Done uploading segments... Aug 7 10:32:43.296332969 (52m42.885677996s) [upload=910]: Upload finished. err: <nil> Aug 7 10:33:24.674653288 (53m24.263998275s) [upload=923]: Starting upload Aug 7 10:33:24.674712130 (53m24.264057107s) [upload=923]: Done starting upload Aug 7 10:33:24.674777174 (53m24.264122151s) [upload=923]: Uploading segments... Aug 7 10:33:24.674821039 (53m24.264166026s) [upload=923]: Got next segment. Inline: true Aug 7 10:33:24.674824635 (53m24.264169623s) [upload=923]: Waiting for error group managing segments... Aug 7 10:33:24.674857558 (53m24.264202545s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:24.674861065 (53m24.264206052s) [upload=923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:24.674863179 (53m24.264208166s) [upload=923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:24.973403258 (53m24.562748245s) [upload=923]: Done uploading segments... Aug 7 10:33:24.973421783 (53m24.56276677s) [upload=923]: Upload finished. err: <nil> Aug 7 10:33:41.331709612 (53m40.9210546s) [upload=927]: Starting upload Aug 7 10:33:41.331754058 (53m40.921099045s) [upload=927]: Done starting upload Aug 7 10:33:41.331818671 (53m40.921163658s) [upload=927]: Uploading segments... Aug 7 10:33:41.331861743 (53m40.92120673s) [upload=927]: Got next segment. Inline: true Aug 7 10:33:41.331865271 (53m40.921210248s) [upload=927]: Waiting for error group managing segments... Aug 7 10:33:41.331935464 (53m40.921280451s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 10:33:41.331939672 (53m40.921284659s) [upload=927]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 10:33:41.331942197 (53m40.921287184s) [upload=927]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 10:33:41.615765738 (53m41.205110725s) [upload=927]: Done uploading segments... Aug 7 10:33:41.615798321 (53m41.205143298s) [upload=927]: Upload finished. err: <nil> Duration:* 1.832234413s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)