Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.8724975s
FAIL (2025-06-30 16:07:38 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 1.872526427s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.864548594s
FAIL (2025-06-30 16:06:24 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 1.864575886s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.189601469s
FAIL (2025-06-30 16:06:05 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 2.189628601s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.008181101s
FAIL (2025-06-30 16:05:38 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 2.008220256s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.86797597s
FAIL (2025-06-30 16:04:29 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 1.868002851s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.896134432s
FAIL (2025-06-30 16:03:30 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 1.896165701s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.911587227s
FAIL (2025-06-30 16:03:10 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 1.911621241s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.893236958s
FAIL (2025-06-30 16:02:29 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 1.893263428s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.994222945s
FAIL (2025-06-30 16:01:31 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 1.994271337s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.89179008s
FAIL (2025-06-30 16:01:02 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 1.891819237s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.215930053s
FAIL (2025-06-30 16:00:23 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 2.215966423s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002233931s
FAIL (2025-06-30 15:59:55 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 524636s) [upload=139638]: Starting upload Jun 30 15:50:30.567977240 (174h40m5.338618575s) [upload=139638]: Done starting upload Jun 30 15:50:30.568059187 (174h40m5.338700522s) [upload=139638]: Uploading segments... Jun 30 15:50:30.568118791 (174h40m5.338760126s) [upload=139638]: Got next segment. Inline: true Jun 30 15:50:30.568124332 (174h40m5.338765667s) [upload=139638]: Waiting for error group managing segments... Jun 30 15:50:30.568164378 (174h40m5.338805714s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:50:30.568169348 (174h40m5.338810683s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:50:30.568171883 (174h40m5.338813218s) [upload=139638]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:50:30.866704396 (174h40m5.637345721s) [upload=139638]: Done uploading segments... Jun 30 15:50:30.866722359 (174h40m5.637363694s) [upload=139638]: Upload finished. err: <nil> Jun 30 15:51:29.670570472 (174h41m4.441211807s) [upload=139654]: Starting upload Jun 30 15:51:29.670657829 (174h41m4.441299164s) [upload=139654]: Done starting upload Jun 30 15:51:29.670713255 (174h41m4.44135459s) [upload=139654]: Uploading segments... Jun 30 15:51:29.670751728 (174h41m4.441393073s) [upload=139654]: Got next segment. Inline: true Jun 30 15:51:29.670757058 (174h41m4.441398403s) [upload=139654]: Waiting for error group managing segments... Jun 30 15:51:29.670799430 (174h41m4.441440765s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:51:29.670805571 (174h41m4.441446907s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:51:29.670808527 (174h41m4.441449862s) [upload=139654]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:51:29.937520995 (174h41m4.70816233s) [upload=139654]: Done uploading segments... Jun 30 15:51:29.937541113 (174h41m4.708182458s) [upload=139654]: Upload finished. err: <nil> Jun 30 15:52:32.854941993 (174h42m7.625583328s) [upload=139667]: Starting upload Jun 30 15:52:32.855093323 (174h42m7.625734658s) [upload=139667]: Done starting upload Jun 30 15:52:32.855269430 (174h42m7.625910775s) [upload=139667]: Uploading segments... Jun 30 15:52:32.855329234 (174h42m7.625970579s) [upload=139667]: Got next segment. Inline: true Jun 30 15:52:32.855334484 (174h42m7.625975819s) [upload=139667]: Waiting for error group managing segments... Jun 30 15:52:32.855370704 (174h42m7.626012039s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:52:32.855375443 (174h42m7.626016778s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:52:32.855377957 (174h42m7.626019292s) [upload=139667]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:52:33.134763960 (174h42m7.905405295s) [upload=139667]: Done uploading segments... Jun 30 15:52:33.134782094 (174h42m7.905423429s) [upload=139667]: Upload finished. err: <nil> Jun 30 15:53:34.942739271 (174h43m9.713380606s) [upload=139680]: Starting upload Jun 30 15:53:34.942788094 (174h43m9.71342943s) [upload=139680]: Done starting upload Jun 30 15:53:34.942833861 (174h43m9.713475196s) [upload=139680]: Uploading segments... Jun 30 15:53:34.942860723 (174h43m9.713502058s) [upload=139680]: Got next segment. Inline: true Jun 30 15:53:34.942864500 (174h43m9.713505825s) [upload=139680]: Waiting for error group managing segments... Jun 30 15:53:34.942896372 (174h43m9.713537707s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:53:34.942901040 (174h43m9.713542375s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:53:34.942903555 (174h43m9.71354488s) [upload=139680]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:53:35.216328894 (174h43m9.986970229s) [upload=139680]: Done uploading segments... Jun 30 15:53:35.216347370 (174h43m9.986988705s) [upload=139680]: Upload finished. err: <nil> Jun 30 15:54:27.100838275 (174h44m1.87147963s) [upload=139692]: Starting upload Jun 30 15:54:27.100954046 (174h44m1.871595381s) [upload=139692]: Done starting upload Jun 30 15:54:27.101028509 (174h44m1.871669844s) [upload=139692]: Uploading segments... Jun 30 15:54:27.101090678 (174h44m1.871732063s) [upload=139692]: Got next segment. Inline: true Jun 30 15:54:27.101097190 (174h44m1.871738555s) [upload=139692]: Waiting for error group managing segments... Jun 30 15:54:27.101141224 (174h44m1.87178256s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:54:27.101146695 (174h44m1.87178803s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:54:27.101148939 (174h44m1.871790274s) [upload=139692]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:54:27.561979059 (174h44m2.332620394s) [upload=139692]: Done uploading segments... Jun 30 15:54:27.561995720 (174h44m2.332637045s) [upload=139692]: Upload finished. err: <nil> Jun 30 15:55:05.413255672 (174h44m40.183897007s) [upload=139699]: Starting upload Jun 30 15:55:05.413307431 (174h44m40.183948766s) [upload=139699]: Done starting upload Jun 30 15:55:05.413367466 (174h44m40.184008801s) [upload=139699]: Uploading segments... Jun 30 15:55:05.413428423 (174h44m40.184069758s) [upload=139699]: Got next segment. Inline: true Jun 30 15:55:05.413433553 (174h44m40.184074878s) [upload=139699]: Waiting for error group managing segments... Jun 30 15:55:05.413473880 (174h44m40.184115215s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:05.413480332 (174h44m40.184121667s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:05.413483138 (174h44m40.184124473s) [upload=139699]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:05.688544537 (174h44m40.459185863s) [upload=139699]: Done uploading segments... Jun 30 15:55:05.688563043 (174h44m40.459204378s) [upload=139699]: Upload finished. err: <nil> Jun 30 15:55:56.133377923 (174h45m30.904019258s) [upload=139710]: Starting upload Jun 30 15:55:56.133437206 (174h45m30.904078541s) [upload=139710]: Done starting upload Jun 30 15:55:56.133491981 (174h45m30.904133306s) [upload=139710]: Uploading segments... Jun 30 15:55:56.133525956 (174h45m30.904167291s) [upload=139710]: Got next segment. Inline: true Jun 30 15:55:56.133531045 (174h45m30.90417238s) [upload=139710]: Waiting for error group managing segments... Jun 30 15:55:56.133566113 (174h45m30.904207448s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:55:56.133570922 (174h45m30.904212257s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:55:56.133573517 (174h45m30.904214852s) [upload=139710]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:55:56.414698989 (174h45m31.185340314s) [upload=139710]: Done uploading segments... Jun 30 15:55:56.414719389 (174h45m31.185360724s) [upload=139710]: Upload finished. err: <nil> Jun 30 15:56:11.431261733 (174h45m46.201903068s) [upload=139714]: Starting upload Jun 30 15:56:11.431311408 (174h45m46.201952743s) [upload=139714]: Done starting upload Jun 30 15:56:11.431366413 (174h45m46.202007738s) [upload=139714]: Uploading segments... Jun 30 15:56:11.431395789 (174h45m46.202037125s) [upload=139714]: Got next segment. Inline: true Jun 30 15:56:11.431399346 (174h45m46.202040681s) [upload=139714]: Waiting for error group managing segments... Jun 30 15:56:11.431430856 (174h45m46.202072191s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:56:11.431435445 (174h45m46.20207678s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:56:11.431438210 (174h45m46.202079545s) [upload=139714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:56:11.714407860 (174h45m46.485049195s) [upload=139714]: Done uploading segments... Jun 30 15:56:11.714426035 (174h45m46.48506736s) [upload=139714]: Upload finished. err: <nil> Jun 30 15:57:23.326036780 (174h46m58.096678115s) [upload=139729]: Starting upload Jun 30 15:57:23.326120901 (174h46m58.096762236s) [upload=139729]: Done starting upload Jun 30 15:57:23.326178000 (174h46m58.096819335s) [upload=139729]: Uploading segments... Jun 30 15:57:23.326210263 (174h46m58.096851598s) [upload=139729]: Got next segment. Inline: true Jun 30 15:57:23.326213970 (174h46m58.096855305s) [upload=139729]: Waiting for error group managing segments... Jun 30 15:57:23.326247654 (174h46m58.096888979s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:57:23.326252303 (174h46m58.096893628s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:57:23.326290185 (174h46m58.09693152s) [upload=139729]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:57:23.603822151 (174h46m58.374463516s) [upload=139729]: Done uploading segments... Jun 30 15:57:23.603841207 (174h46m58.374482542s) [upload=139729]: Upload finished. err: <nil> Jun 30 15:58:37.844911786 (174h48m12.615553121s) [upload=139743]: Starting upload Jun 30 15:58:37.844975849 (174h48m12.615617184s) [upload=139743]: Done starting upload Jun 30 15:58:37.845024942 (174h48m12.615666277s) [upload=139743]: Uploading segments... Jun 30 15:58:37.845052084 (174h48m12.615693419s) [upload=139743]: Got next segment. Inline: true Jun 30 15:58:37.845055701 (174h48m12.615697026s) [upload=139743]: Waiting for error group managing segments... Jun 30 15:58:37.845086240 (174h48m12.615727575s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 15:58:37.845090979 (174h48m12.615732314s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 15:58:37.845093303 (174h48m12.615734638s) [upload=139743]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 15:58:38.118447969 (174h48m12.889089294s) [upload=139743]: Done uploading segments... Jun 30 15:58:38.118466284 (174h48m12.889107619s) [upload=139743]: Upload finished. err: <nil>
Duration: 30.002252878s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
7.745650248s
FAIL (2025-06-30 13:20:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.746001209s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
6.097375706s
FAIL (2025-06-30 13:19:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.097397116s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.257399556s
FAIL (2025-06-30 13:19:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.257421247s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.860627639s
FAIL (2025-06-30 13:18:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.860651785s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.988292166s
FAIL (2025-06-30 13:17:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.98834639s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
7.499461288s
FAIL (2025-06-30 13:16:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.499572703s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.133710487s
FAIL (2025-06-30 13:15:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.133730596s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.899059737s
FAIL (2025-06-30 13:15:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.899098731s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.93206227s
FAIL (2025-06-30 13:14:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.932086587s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.823885216s
FAIL (2025-06-30 13:13:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.823922547s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.916584349s
FAIL (2025-06-30 13:12:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.91660666s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.050359889s
FAIL (2025-06-30 13:11:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.050385769s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
6.11857575s
FAIL (2025-06-30 13:11:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.118620116s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.299347146s
FAIL (2025-06-30 13:10:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.299372885s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
6.174808469s
FAIL (2025-06-30 13:10:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.174836011s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
6.023371721s
FAIL (2025-06-30 13:09:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.023391489s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.938151503s
FAIL (2025-06-30 13:09:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.938172454s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
6.093067306s
FAIL (2025-06-30 13:07:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.093090811s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
6.068339119s
FAIL (2025-06-30 13:07:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.068359999s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
6.780163383s
FAIL (2025-06-30 13:06:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.780186737s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
6.116852159s
FAIL (2025-06-30 13:05:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.116874541s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
6.070111199s
FAIL (2025-06-30 13:04:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.070135916s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
6.151095473s
FAIL (2025-06-30 13:04:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.15111528s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.885114202s
FAIL (2025-06-30 13:03:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.885136975s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
6.027223053s
FAIL (2025-06-30 13:02:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.027253732s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
5.861118113s
FAIL (2025-06-30 13:01:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.861141307s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.988313506s
FAIL (2025-06-30 13:01:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.988339847s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.979126019s
FAIL (2025-06-30 13:00:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.979154763s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.878670585s
FAIL (2025-06-30 12:59:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.878701984s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
5.977668518s
FAIL (2025-06-30 12:59:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.977694726s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.857072785s
FAIL (2025-06-30 12:58:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.857089677s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.196308092s
FAIL (2025-06-30 12:57:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.196328823s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.065368025s
FAIL (2025-06-30 12:57:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.065676854s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.970603397s
FAIL (2025-06-30 12:56:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.970652529s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
6.197890433s
FAIL (2025-06-30 12:56:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.197996626s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
6.144617325s
FAIL (2025-06-30 12:56:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.144645559s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.976024362s
FAIL (2025-06-30 12:55:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.97604496s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
6.240560357s
FAIL (2025-06-30 12:54:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.240610153s
edge
gateway
us-select-1
|