Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.965439487s
FAIL (2025-07-24 10:01:57 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 813s) [upload=104702]: Starting upload Jul 24 09:46:57.683505650 (130h56m4.056085005s) [upload=104702]: Done starting upload Jul 24 09:46:57.683557279 (130h56m4.056136634s) [upload=104702]: Uploading segments... Jul 24 09:46:57.683587847 (130h56m4.056167202s) [upload=104702]: Got next segment. Inline: true Jul 24 09:46:57.683591223 (130h56m4.056170578s) [upload=104702]: Waiting for error group managing segments... Jul 24 09:46:57.683627943 (130h56m4.056207298s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:46:57.683632302 (130h56m4.056211657s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:46:57.683635338 (130h56m4.056214693s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:46:58.027539489 (130h56m4.400118845s) [upload=104702]: Done uploading segments... Jul 24 09:46:58.027555950 (130h56m4.400135305s) [upload=104702]: Upload finished. err: <nil> Jul 24 09:47:14.659060250 (130h56m21.031639595s) [upload=104705]: Starting upload Jul 24 09:47:14.659136015 (130h56m21.03171536s) [upload=104705]: Done starting upload Jul 24 09:47:14.659198274 (130h56m21.031777629s) [upload=104705]: Uploading segments... Jul 24 09:47:14.659234294 (130h56m21.031813639s) [upload=104705]: Got next segment. Inline: true Jul 24 09:47:14.659238311 (130h56m21.031817656s) [upload=104705]: Waiting for error group managing segments... Jul 24 09:47:14.659268970 (130h56m21.031848325s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:14.659273729 (130h56m21.031853084s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:14.659276404 (130h56m21.031855749s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:14.972135203 (130h56m21.344714558s) [upload=104705]: Done uploading segments... Jul 24 09:47:14.972153989 (130h56m21.344733344s) [upload=104705]: Upload finished. err: <nil> Jul 24 09:47:51.417630323 (130h56m57.790209678s) [upload=104714]: Starting upload Jul 24 09:47:51.417696018 (130h56m57.790275373s) [upload=104714]: Done starting upload Jul 24 09:47:51.417758006 (130h56m57.790337361s) [upload=104714]: Uploading segments... Jul 24 09:47:51.417836797 (130h56m57.790416142s) [upload=104714]: Got next segment. Inline: true Jul 24 09:47:51.417841035 (130h56m57.79042039s) [upload=104714]: Waiting for error group managing segments... Jul 24 09:47:51.417877385 (130h56m57.790456741s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:51.417882114 (130h56m57.790461469s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:51.417884579 (130h56m57.790463934s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:51.693929209 (130h56m58.066508564s) [upload=104714]: Done uploading segments... Jul 24 09:47:51.693948486 (130h56m58.066527841s) [upload=104714]: Upload finished. err: <nil> Jul 24 09:48:30.339202112 (130h57m36.711781467s) [upload=104721]: Starting upload Jul 24 09:48:30.339261806 (130h57m36.711841161s) [upload=104721]: Done starting upload Jul 24 09:48:30.339324405 (130h57m36.711903761s) [upload=104721]: Uploading segments... Jul 24 09:48:30.339403888 (130h57m36.711983243s) [upload=104721]: Got next segment. Inline: true Jul 24 09:48:30.339408376 (130h57m36.711987732s) [upload=104721]: Waiting for error group managing segments... Jul 24 09:48:30.339448363 (130h57m36.712027718s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:30.339453262 (130h57m36.712032617s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:30.339455587 (130h57m36.712034942s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:30.640282044 (130h57m37.012861399s) [upload=104721]: Done uploading segments... Jul 24 09:48:30.640296521 (130h57m37.012875876s) [upload=104721]: Upload finished. err: <nil> Jul 24 09:48:46.345209259 (130h57m52.717788615s) [upload=104724]: Starting upload Jul 24 09:48:46.345259656 (130h57m52.717839011s) [upload=104724]: Done starting upload Jul 24 09:48:46.345303189 (130h57m52.717882544s) [upload=104724]: Uploading segments... Jul 24 09:48:46.345377631 (130h57m52.717956987s) [upload=104724]: Got next segment. Inline: true Jul 24 09:48:46.345381759 (130h57m52.717961114s) [upload=104724]: Waiting for error group managing segments... Jul 24 09:48:46.345430032 (130h57m52.718009377s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:46.345438027 (130h57m52.718017382s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:46.345440652 (130h57m52.718020007s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:46.625333176 (130h57m52.997912531s) [upload=104724]: Done uploading segments... Jul 24 09:48:46.625348975 (130h57m52.99792832s) [upload=104724]: Upload finished. err: <nil> Jul 24 09:49:53.971630320 (130h59m0.344209675s) [upload=104740]: Starting upload Jul 24 09:49:53.971686478 (130h59m0.344265833s) [upload=104740]: Done starting upload Jul 24 09:49:53.971735882 (130h59m0.344315237s) [upload=104740]: Uploading segments... Jul 24 09:49:53.971768785 (130h59m0.34434814s) [upload=104740]: Got next segment. Inline: true Jul 24 09:49:53.971772703 (130h59m0.344352058s) [upload=104740]: Waiting for error group managing segments... Jul 24 09:49:53.971805325 (130h59m0.34438468s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:49:53.971810485 (130h59m0.34438984s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:49:53.971813109 (130h59m0.344392465s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:49:54.251260420 (130h59m0.623839765s) [upload=104740]: Done uploading segments... Jul 24 09:49:54.251276872 (130h59m0.623856227s) [upload=104740]: Upload finished. err: <nil> Jul 24 09:50:48.811147701 (130h59m55.183727056s) [upload=104752]: Starting upload Jul 24 09:50:48.811259444 (130h59m55.183838829s) [upload=104752]: Done starting upload Jul 24 09:50:48.811386498 (130h59m55.183965883s) [upload=104752]: Uploading segments... Jul 24 09:50:48.811437335 (130h59m55.18401669s) [upload=104752]: Got next segment. Inline: true Jul 24 09:50:48.811441182 (130h59m55.184020538s) [upload=104752]: Waiting for error group managing segments... Jul 24 09:50:48.811474957 (130h59m55.184054312s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:50:48.811479656 (130h59m55.184059011s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:50:48.811482131 (130h59m55.184061486s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:50:49.085645812 (130h59m55.458225167s) [upload=104752]: Done uploading segments... Jul 24 09:50:49.085664027 (130h59m55.458243382s) [upload=104752]: Upload finished. err: <nil> Jul 24 09:51:52.143001303 (131h0m58.515580658s) [upload=104767]: Starting upload Jul 24 09:51:52.143067560 (131h0m58.515646915s) [upload=104767]: Done starting upload Jul 24 09:51:52.143126222 (131h0m58.515705577s) [upload=104767]: Uploading segments... Jul 24 09:51:52.143163774 (131h0m58.515743129s) [upload=104767]: Got next segment. Inline: true Jul 24 09:51:52.143167592 (131h0m58.515746947s) [upload=104767]: Waiting for error group managing segments... Jul 24 09:51:52.143202719 (131h0m58.515782074s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:51:52.143207468 (131h0m58.515786813s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:51:52.143210043 (131h0m58.515789388s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:51:52.596288812 (131h0m58.968868157s) [upload=104767]: Done uploading segments... Jul 24 09:51:52.596306687 (131h0m58.968886032s) [upload=104767]: Upload finished. err: <nil> Jul 24 09:52:34.688885621 (131h1m41.061464966s) [upload=104775]: Starting upload Jul 24 09:52:34.688938663 (131h1m41.061518018s) [upload=104775]: Done starting upload Jul 24 09:52:34.688983298 (131h1m41.061562653s) [upload=104775]: Uploading segments... Jul 24 09:52:34.689010750 (131h1m41.061590105s) [upload=104775]: Got next segment. Inline: true Jul 24 09:52:34.689014378 (131h1m41.061593733s) [upload=104775]: Waiting for error group managing segments... Jul 24 09:52:34.689050106 (131h1m41.061629461s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:52:34.689054504 (131h1m41.061633849s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:52:34.689058522 (131h1m41.061637877s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:52:34.985853686 (131h1m41.358433031s) [upload=104775]: Done uploading segments... Jul 24 09:52:34.985874075 (131h1m41.35845343s) [upload=104775]: Upload finished. err: <nil> Jul 24 09:53:33.658681752 (131h2m40.031261107s) [upload=104789]: Starting upload Jul 24 09:53:33.658743130 (131h2m40.031322475s) [upload=104789]: Done starting upload Jul 24 09:53:33.658852189 (131h2m40.031431544s) [upload=104789]: Uploading segments... Jul 24 09:53:33.658886614 (131h2m40.031465969s) [upload=104789]: Got next segment. Inline: true Jul 24 09:53:33.658890441 (131h2m40.031469796s) [upload=104789]: Waiting for error group managing segments... Jul 24 09:53:33.658935548 (131h2m40.031514903s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:53:33.658940047 (131h2m40.031519402s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:53:33.658942892 (131h2m40.031522247s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:53:34.044724862 (131h2m40.417304227s) [upload=104789]: Done uploading segments... Jul 24 09:53:34.044748257 (131h2m40.417327612s) [upload=104789]: Upload finished. err: <nil>
Duration: 1.965465207s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.880462384s
FAIL (2025-07-24 10:00:47 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 813s) [upload=104702]: Starting upload Jul 24 09:46:57.683505650 (130h56m4.056085005s) [upload=104702]: Done starting upload Jul 24 09:46:57.683557279 (130h56m4.056136634s) [upload=104702]: Uploading segments... Jul 24 09:46:57.683587847 (130h56m4.056167202s) [upload=104702]: Got next segment. Inline: true Jul 24 09:46:57.683591223 (130h56m4.056170578s) [upload=104702]: Waiting for error group managing segments... Jul 24 09:46:57.683627943 (130h56m4.056207298s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:46:57.683632302 (130h56m4.056211657s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:46:57.683635338 (130h56m4.056214693s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:46:58.027539489 (130h56m4.400118845s) [upload=104702]: Done uploading segments... Jul 24 09:46:58.027555950 (130h56m4.400135305s) [upload=104702]: Upload finished. err: <nil> Jul 24 09:47:14.659060250 (130h56m21.031639595s) [upload=104705]: Starting upload Jul 24 09:47:14.659136015 (130h56m21.03171536s) [upload=104705]: Done starting upload Jul 24 09:47:14.659198274 (130h56m21.031777629s) [upload=104705]: Uploading segments... Jul 24 09:47:14.659234294 (130h56m21.031813639s) [upload=104705]: Got next segment. Inline: true Jul 24 09:47:14.659238311 (130h56m21.031817656s) [upload=104705]: Waiting for error group managing segments... Jul 24 09:47:14.659268970 (130h56m21.031848325s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:14.659273729 (130h56m21.031853084s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:14.659276404 (130h56m21.031855749s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:14.972135203 (130h56m21.344714558s) [upload=104705]: Done uploading segments... Jul 24 09:47:14.972153989 (130h56m21.344733344s) [upload=104705]: Upload finished. err: <nil> Jul 24 09:47:51.417630323 (130h56m57.790209678s) [upload=104714]: Starting upload Jul 24 09:47:51.417696018 (130h56m57.790275373s) [upload=104714]: Done starting upload Jul 24 09:47:51.417758006 (130h56m57.790337361s) [upload=104714]: Uploading segments... Jul 24 09:47:51.417836797 (130h56m57.790416142s) [upload=104714]: Got next segment. Inline: true Jul 24 09:47:51.417841035 (130h56m57.79042039s) [upload=104714]: Waiting for error group managing segments... Jul 24 09:47:51.417877385 (130h56m57.790456741s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:51.417882114 (130h56m57.790461469s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:51.417884579 (130h56m57.790463934s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:51.693929209 (130h56m58.066508564s) [upload=104714]: Done uploading segments... Jul 24 09:47:51.693948486 (130h56m58.066527841s) [upload=104714]: Upload finished. err: <nil> Jul 24 09:48:30.339202112 (130h57m36.711781467s) [upload=104721]: Starting upload Jul 24 09:48:30.339261806 (130h57m36.711841161s) [upload=104721]: Done starting upload Jul 24 09:48:30.339324405 (130h57m36.711903761s) [upload=104721]: Uploading segments... Jul 24 09:48:30.339403888 (130h57m36.711983243s) [upload=104721]: Got next segment. Inline: true Jul 24 09:48:30.339408376 (130h57m36.711987732s) [upload=104721]: Waiting for error group managing segments... Jul 24 09:48:30.339448363 (130h57m36.712027718s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:30.339453262 (130h57m36.712032617s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:30.339455587 (130h57m36.712034942s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:30.640282044 (130h57m37.012861399s) [upload=104721]: Done uploading segments... Jul 24 09:48:30.640296521 (130h57m37.012875876s) [upload=104721]: Upload finished. err: <nil> Jul 24 09:48:46.345209259 (130h57m52.717788615s) [upload=104724]: Starting upload Jul 24 09:48:46.345259656 (130h57m52.717839011s) [upload=104724]: Done starting upload Jul 24 09:48:46.345303189 (130h57m52.717882544s) [upload=104724]: Uploading segments... Jul 24 09:48:46.345377631 (130h57m52.717956987s) [upload=104724]: Got next segment. Inline: true Jul 24 09:48:46.345381759 (130h57m52.717961114s) [upload=104724]: Waiting for error group managing segments... Jul 24 09:48:46.345430032 (130h57m52.718009377s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:46.345438027 (130h57m52.718017382s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:46.345440652 (130h57m52.718020007s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:46.625333176 (130h57m52.997912531s) [upload=104724]: Done uploading segments... Jul 24 09:48:46.625348975 (130h57m52.99792832s) [upload=104724]: Upload finished. err: <nil> Jul 24 09:49:53.971630320 (130h59m0.344209675s) [upload=104740]: Starting upload Jul 24 09:49:53.971686478 (130h59m0.344265833s) [upload=104740]: Done starting upload Jul 24 09:49:53.971735882 (130h59m0.344315237s) [upload=104740]: Uploading segments... Jul 24 09:49:53.971768785 (130h59m0.34434814s) [upload=104740]: Got next segment. Inline: true Jul 24 09:49:53.971772703 (130h59m0.344352058s) [upload=104740]: Waiting for error group managing segments... Jul 24 09:49:53.971805325 (130h59m0.34438468s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:49:53.971810485 (130h59m0.34438984s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:49:53.971813109 (130h59m0.344392465s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:49:54.251260420 (130h59m0.623839765s) [upload=104740]: Done uploading segments... Jul 24 09:49:54.251276872 (130h59m0.623856227s) [upload=104740]: Upload finished. err: <nil> Jul 24 09:50:48.811147701 (130h59m55.183727056s) [upload=104752]: Starting upload Jul 24 09:50:48.811259444 (130h59m55.183838829s) [upload=104752]: Done starting upload Jul 24 09:50:48.811386498 (130h59m55.183965883s) [upload=104752]: Uploading segments... Jul 24 09:50:48.811437335 (130h59m55.18401669s) [upload=104752]: Got next segment. Inline: true Jul 24 09:50:48.811441182 (130h59m55.184020538s) [upload=104752]: Waiting for error group managing segments... Jul 24 09:50:48.811474957 (130h59m55.184054312s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:50:48.811479656 (130h59m55.184059011s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:50:48.811482131 (130h59m55.184061486s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:50:49.085645812 (130h59m55.458225167s) [upload=104752]: Done uploading segments... Jul 24 09:50:49.085664027 (130h59m55.458243382s) [upload=104752]: Upload finished. err: <nil> Jul 24 09:51:52.143001303 (131h0m58.515580658s) [upload=104767]: Starting upload Jul 24 09:51:52.143067560 (131h0m58.515646915s) [upload=104767]: Done starting upload Jul 24 09:51:52.143126222 (131h0m58.515705577s) [upload=104767]: Uploading segments... Jul 24 09:51:52.143163774 (131h0m58.515743129s) [upload=104767]: Got next segment. Inline: true Jul 24 09:51:52.143167592 (131h0m58.515746947s) [upload=104767]: Waiting for error group managing segments... Jul 24 09:51:52.143202719 (131h0m58.515782074s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:51:52.143207468 (131h0m58.515786813s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:51:52.143210043 (131h0m58.515789388s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:51:52.596288812 (131h0m58.968868157s) [upload=104767]: Done uploading segments... Jul 24 09:51:52.596306687 (131h0m58.968886032s) [upload=104767]: Upload finished. err: <nil> Jul 24 09:52:34.688885621 (131h1m41.061464966s) [upload=104775]: Starting upload Jul 24 09:52:34.688938663 (131h1m41.061518018s) [upload=104775]: Done starting upload Jul 24 09:52:34.688983298 (131h1m41.061562653s) [upload=104775]: Uploading segments... Jul 24 09:52:34.689010750 (131h1m41.061590105s) [upload=104775]: Got next segment. Inline: true Jul 24 09:52:34.689014378 (131h1m41.061593733s) [upload=104775]: Waiting for error group managing segments... Jul 24 09:52:34.689050106 (131h1m41.061629461s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:52:34.689054504 (131h1m41.061633849s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:52:34.689058522 (131h1m41.061637877s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:52:34.985853686 (131h1m41.358433031s) [upload=104775]: Done uploading segments... Jul 24 09:52:34.985874075 (131h1m41.35845343s) [upload=104775]: Upload finished. err: <nil> Jul 24 09:53:33.658681752 (131h2m40.031261107s) [upload=104789]: Starting upload Jul 24 09:53:33.658743130 (131h2m40.031322475s) [upload=104789]: Done starting upload Jul 24 09:53:33.658852189 (131h2m40.031431544s) [upload=104789]: Uploading segments... Jul 24 09:53:33.658886614 (131h2m40.031465969s) [upload=104789]: Got next segment. Inline: true Jul 24 09:53:33.658890441 (131h2m40.031469796s) [upload=104789]: Waiting for error group managing segments... Jul 24 09:53:33.658935548 (131h2m40.031514903s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:53:33.658940047 (131h2m40.031519402s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:53:33.658942892 (131h2m40.031522247s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:53:34.044724862 (131h2m40.417304227s) [upload=104789]: Done uploading segments... Jul 24 09:53:34.044748257 (131h2m40.417327612s) [upload=104789]: Upload finished. err: <nil>
Duration: 1.880493935s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.930913069s
FAIL (2025-07-24 09:59:43 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 813s) [upload=104702]: Starting upload Jul 24 09:46:57.683505650 (130h56m4.056085005s) [upload=104702]: Done starting upload Jul 24 09:46:57.683557279 (130h56m4.056136634s) [upload=104702]: Uploading segments... Jul 24 09:46:57.683587847 (130h56m4.056167202s) [upload=104702]: Got next segment. Inline: true Jul 24 09:46:57.683591223 (130h56m4.056170578s) [upload=104702]: Waiting for error group managing segments... Jul 24 09:46:57.683627943 (130h56m4.056207298s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:46:57.683632302 (130h56m4.056211657s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:46:57.683635338 (130h56m4.056214693s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:46:58.027539489 (130h56m4.400118845s) [upload=104702]: Done uploading segments... Jul 24 09:46:58.027555950 (130h56m4.400135305s) [upload=104702]: Upload finished. err: <nil> Jul 24 09:47:14.659060250 (130h56m21.031639595s) [upload=104705]: Starting upload Jul 24 09:47:14.659136015 (130h56m21.03171536s) [upload=104705]: Done starting upload Jul 24 09:47:14.659198274 (130h56m21.031777629s) [upload=104705]: Uploading segments... Jul 24 09:47:14.659234294 (130h56m21.031813639s) [upload=104705]: Got next segment. Inline: true Jul 24 09:47:14.659238311 (130h56m21.031817656s) [upload=104705]: Waiting for error group managing segments... Jul 24 09:47:14.659268970 (130h56m21.031848325s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:14.659273729 (130h56m21.031853084s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:14.659276404 (130h56m21.031855749s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:14.972135203 (130h56m21.344714558s) [upload=104705]: Done uploading segments... Jul 24 09:47:14.972153989 (130h56m21.344733344s) [upload=104705]: Upload finished. err: <nil> Jul 24 09:47:51.417630323 (130h56m57.790209678s) [upload=104714]: Starting upload Jul 24 09:47:51.417696018 (130h56m57.790275373s) [upload=104714]: Done starting upload Jul 24 09:47:51.417758006 (130h56m57.790337361s) [upload=104714]: Uploading segments... Jul 24 09:47:51.417836797 (130h56m57.790416142s) [upload=104714]: Got next segment. Inline: true Jul 24 09:47:51.417841035 (130h56m57.79042039s) [upload=104714]: Waiting for error group managing segments... Jul 24 09:47:51.417877385 (130h56m57.790456741s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:51.417882114 (130h56m57.790461469s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:51.417884579 (130h56m57.790463934s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:51.693929209 (130h56m58.066508564s) [upload=104714]: Done uploading segments... Jul 24 09:47:51.693948486 (130h56m58.066527841s) [upload=104714]: Upload finished. err: <nil> Jul 24 09:48:30.339202112 (130h57m36.711781467s) [upload=104721]: Starting upload Jul 24 09:48:30.339261806 (130h57m36.711841161s) [upload=104721]: Done starting upload Jul 24 09:48:30.339324405 (130h57m36.711903761s) [upload=104721]: Uploading segments... Jul 24 09:48:30.339403888 (130h57m36.711983243s) [upload=104721]: Got next segment. Inline: true Jul 24 09:48:30.339408376 (130h57m36.711987732s) [upload=104721]: Waiting for error group managing segments... Jul 24 09:48:30.339448363 (130h57m36.712027718s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:30.339453262 (130h57m36.712032617s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:30.339455587 (130h57m36.712034942s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:30.640282044 (130h57m37.012861399s) [upload=104721]: Done uploading segments... Jul 24 09:48:30.640296521 (130h57m37.012875876s) [upload=104721]: Upload finished. err: <nil> Jul 24 09:48:46.345209259 (130h57m52.717788615s) [upload=104724]: Starting upload Jul 24 09:48:46.345259656 (130h57m52.717839011s) [upload=104724]: Done starting upload Jul 24 09:48:46.345303189 (130h57m52.717882544s) [upload=104724]: Uploading segments... Jul 24 09:48:46.345377631 (130h57m52.717956987s) [upload=104724]: Got next segment. Inline: true Jul 24 09:48:46.345381759 (130h57m52.717961114s) [upload=104724]: Waiting for error group managing segments... Jul 24 09:48:46.345430032 (130h57m52.718009377s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:46.345438027 (130h57m52.718017382s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:46.345440652 (130h57m52.718020007s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:46.625333176 (130h57m52.997912531s) [upload=104724]: Done uploading segments... Jul 24 09:48:46.625348975 (130h57m52.99792832s) [upload=104724]: Upload finished. err: <nil> Jul 24 09:49:53.971630320 (130h59m0.344209675s) [upload=104740]: Starting upload Jul 24 09:49:53.971686478 (130h59m0.344265833s) [upload=104740]: Done starting upload Jul 24 09:49:53.971735882 (130h59m0.344315237s) [upload=104740]: Uploading segments... Jul 24 09:49:53.971768785 (130h59m0.34434814s) [upload=104740]: Got next segment. Inline: true Jul 24 09:49:53.971772703 (130h59m0.344352058s) [upload=104740]: Waiting for error group managing segments... Jul 24 09:49:53.971805325 (130h59m0.34438468s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:49:53.971810485 (130h59m0.34438984s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:49:53.971813109 (130h59m0.344392465s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:49:54.251260420 (130h59m0.623839765s) [upload=104740]: Done uploading segments... Jul 24 09:49:54.251276872 (130h59m0.623856227s) [upload=104740]: Upload finished. err: <nil> Jul 24 09:50:48.811147701 (130h59m55.183727056s) [upload=104752]: Starting upload Jul 24 09:50:48.811259444 (130h59m55.183838829s) [upload=104752]: Done starting upload Jul 24 09:50:48.811386498 (130h59m55.183965883s) [upload=104752]: Uploading segments... Jul 24 09:50:48.811437335 (130h59m55.18401669s) [upload=104752]: Got next segment. Inline: true Jul 24 09:50:48.811441182 (130h59m55.184020538s) [upload=104752]: Waiting for error group managing segments... Jul 24 09:50:48.811474957 (130h59m55.184054312s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:50:48.811479656 (130h59m55.184059011s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:50:48.811482131 (130h59m55.184061486s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:50:49.085645812 (130h59m55.458225167s) [upload=104752]: Done uploading segments... Jul 24 09:50:49.085664027 (130h59m55.458243382s) [upload=104752]: Upload finished. err: <nil> Jul 24 09:51:52.143001303 (131h0m58.515580658s) [upload=104767]: Starting upload Jul 24 09:51:52.143067560 (131h0m58.515646915s) [upload=104767]: Done starting upload Jul 24 09:51:52.143126222 (131h0m58.515705577s) [upload=104767]: Uploading segments... Jul 24 09:51:52.143163774 (131h0m58.515743129s) [upload=104767]: Got next segment. Inline: true Jul 24 09:51:52.143167592 (131h0m58.515746947s) [upload=104767]: Waiting for error group managing segments... Jul 24 09:51:52.143202719 (131h0m58.515782074s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:51:52.143207468 (131h0m58.515786813s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:51:52.143210043 (131h0m58.515789388s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:51:52.596288812 (131h0m58.968868157s) [upload=104767]: Done uploading segments... Jul 24 09:51:52.596306687 (131h0m58.968886032s) [upload=104767]: Upload finished. err: <nil> Jul 24 09:52:34.688885621 (131h1m41.061464966s) [upload=104775]: Starting upload Jul 24 09:52:34.688938663 (131h1m41.061518018s) [upload=104775]: Done starting upload Jul 24 09:52:34.688983298 (131h1m41.061562653s) [upload=104775]: Uploading segments... Jul 24 09:52:34.689010750 (131h1m41.061590105s) [upload=104775]: Got next segment. Inline: true Jul 24 09:52:34.689014378 (131h1m41.061593733s) [upload=104775]: Waiting for error group managing segments... Jul 24 09:52:34.689050106 (131h1m41.061629461s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:52:34.689054504 (131h1m41.061633849s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:52:34.689058522 (131h1m41.061637877s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:52:34.985853686 (131h1m41.358433031s) [upload=104775]: Done uploading segments... Jul 24 09:52:34.985874075 (131h1m41.35845343s) [upload=104775]: Upload finished. err: <nil> Jul 24 09:53:33.658681752 (131h2m40.031261107s) [upload=104789]: Starting upload Jul 24 09:53:33.658743130 (131h2m40.031322475s) [upload=104789]: Done starting upload Jul 24 09:53:33.658852189 (131h2m40.031431544s) [upload=104789]: Uploading segments... Jul 24 09:53:33.658886614 (131h2m40.031465969s) [upload=104789]: Got next segment. Inline: true Jul 24 09:53:33.658890441 (131h2m40.031469796s) [upload=104789]: Waiting for error group managing segments... Jul 24 09:53:33.658935548 (131h2m40.031514903s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:53:33.658940047 (131h2m40.031519402s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:53:33.658942892 (131h2m40.031522247s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:53:34.044724862 (131h2m40.417304227s) [upload=104789]: Done uploading segments... Jul 24 09:53:34.044748257 (131h2m40.417327612s) [upload=104789]: Upload finished. err: <nil>
Duration: 1.930934087s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.904072656s
FAIL (2025-07-24 09:58:55 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 813s) [upload=104702]: Starting upload Jul 24 09:46:57.683505650 (130h56m4.056085005s) [upload=104702]: Done starting upload Jul 24 09:46:57.683557279 (130h56m4.056136634s) [upload=104702]: Uploading segments... Jul 24 09:46:57.683587847 (130h56m4.056167202s) [upload=104702]: Got next segment. Inline: true Jul 24 09:46:57.683591223 (130h56m4.056170578s) [upload=104702]: Waiting for error group managing segments... Jul 24 09:46:57.683627943 (130h56m4.056207298s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:46:57.683632302 (130h56m4.056211657s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:46:57.683635338 (130h56m4.056214693s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:46:58.027539489 (130h56m4.400118845s) [upload=104702]: Done uploading segments... Jul 24 09:46:58.027555950 (130h56m4.400135305s) [upload=104702]: Upload finished. err: <nil> Jul 24 09:47:14.659060250 (130h56m21.031639595s) [upload=104705]: Starting upload Jul 24 09:47:14.659136015 (130h56m21.03171536s) [upload=104705]: Done starting upload Jul 24 09:47:14.659198274 (130h56m21.031777629s) [upload=104705]: Uploading segments... Jul 24 09:47:14.659234294 (130h56m21.031813639s) [upload=104705]: Got next segment. Inline: true Jul 24 09:47:14.659238311 (130h56m21.031817656s) [upload=104705]: Waiting for error group managing segments... Jul 24 09:47:14.659268970 (130h56m21.031848325s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:14.659273729 (130h56m21.031853084s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:14.659276404 (130h56m21.031855749s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:14.972135203 (130h56m21.344714558s) [upload=104705]: Done uploading segments... Jul 24 09:47:14.972153989 (130h56m21.344733344s) [upload=104705]: Upload finished. err: <nil> Jul 24 09:47:51.417630323 (130h56m57.790209678s) [upload=104714]: Starting upload Jul 24 09:47:51.417696018 (130h56m57.790275373s) [upload=104714]: Done starting upload Jul 24 09:47:51.417758006 (130h56m57.790337361s) [upload=104714]: Uploading segments... Jul 24 09:47:51.417836797 (130h56m57.790416142s) [upload=104714]: Got next segment. Inline: true Jul 24 09:47:51.417841035 (130h56m57.79042039s) [upload=104714]: Waiting for error group managing segments... Jul 24 09:47:51.417877385 (130h56m57.790456741s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:51.417882114 (130h56m57.790461469s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:51.417884579 (130h56m57.790463934s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:51.693929209 (130h56m58.066508564s) [upload=104714]: Done uploading segments... Jul 24 09:47:51.693948486 (130h56m58.066527841s) [upload=104714]: Upload finished. err: <nil> Jul 24 09:48:30.339202112 (130h57m36.711781467s) [upload=104721]: Starting upload Jul 24 09:48:30.339261806 (130h57m36.711841161s) [upload=104721]: Done starting upload Jul 24 09:48:30.339324405 (130h57m36.711903761s) [upload=104721]: Uploading segments... Jul 24 09:48:30.339403888 (130h57m36.711983243s) [upload=104721]: Got next segment. Inline: true Jul 24 09:48:30.339408376 (130h57m36.711987732s) [upload=104721]: Waiting for error group managing segments... Jul 24 09:48:30.339448363 (130h57m36.712027718s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:30.339453262 (130h57m36.712032617s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:30.339455587 (130h57m36.712034942s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:30.640282044 (130h57m37.012861399s) [upload=104721]: Done uploading segments... Jul 24 09:48:30.640296521 (130h57m37.012875876s) [upload=104721]: Upload finished. err: <nil> Jul 24 09:48:46.345209259 (130h57m52.717788615s) [upload=104724]: Starting upload Jul 24 09:48:46.345259656 (130h57m52.717839011s) [upload=104724]: Done starting upload Jul 24 09:48:46.345303189 (130h57m52.717882544s) [upload=104724]: Uploading segments... Jul 24 09:48:46.345377631 (130h57m52.717956987s) [upload=104724]: Got next segment. Inline: true Jul 24 09:48:46.345381759 (130h57m52.717961114s) [upload=104724]: Waiting for error group managing segments... Jul 24 09:48:46.345430032 (130h57m52.718009377s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:46.345438027 (130h57m52.718017382s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:46.345440652 (130h57m52.718020007s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:46.625333176 (130h57m52.997912531s) [upload=104724]: Done uploading segments... Jul 24 09:48:46.625348975 (130h57m52.99792832s) [upload=104724]: Upload finished. err: <nil> Jul 24 09:49:53.971630320 (130h59m0.344209675s) [upload=104740]: Starting upload Jul 24 09:49:53.971686478 (130h59m0.344265833s) [upload=104740]: Done starting upload Jul 24 09:49:53.971735882 (130h59m0.344315237s) [upload=104740]: Uploading segments... Jul 24 09:49:53.971768785 (130h59m0.34434814s) [upload=104740]: Got next segment. Inline: true Jul 24 09:49:53.971772703 (130h59m0.344352058s) [upload=104740]: Waiting for error group managing segments... Jul 24 09:49:53.971805325 (130h59m0.34438468s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:49:53.971810485 (130h59m0.34438984s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:49:53.971813109 (130h59m0.344392465s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:49:54.251260420 (130h59m0.623839765s) [upload=104740]: Done uploading segments... Jul 24 09:49:54.251276872 (130h59m0.623856227s) [upload=104740]: Upload finished. err: <nil> Jul 24 09:50:48.811147701 (130h59m55.183727056s) [upload=104752]: Starting upload Jul 24 09:50:48.811259444 (130h59m55.183838829s) [upload=104752]: Done starting upload Jul 24 09:50:48.811386498 (130h59m55.183965883s) [upload=104752]: Uploading segments... Jul 24 09:50:48.811437335 (130h59m55.18401669s) [upload=104752]: Got next segment. Inline: true Jul 24 09:50:48.811441182 (130h59m55.184020538s) [upload=104752]: Waiting for error group managing segments... Jul 24 09:50:48.811474957 (130h59m55.184054312s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:50:48.811479656 (130h59m55.184059011s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:50:48.811482131 (130h59m55.184061486s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:50:49.085645812 (130h59m55.458225167s) [upload=104752]: Done uploading segments... Jul 24 09:50:49.085664027 (130h59m55.458243382s) [upload=104752]: Upload finished. err: <nil> Jul 24 09:51:52.143001303 (131h0m58.515580658s) [upload=104767]: Starting upload Jul 24 09:51:52.143067560 (131h0m58.515646915s) [upload=104767]: Done starting upload Jul 24 09:51:52.143126222 (131h0m58.515705577s) [upload=104767]: Uploading segments... Jul 24 09:51:52.143163774 (131h0m58.515743129s) [upload=104767]: Got next segment. Inline: true Jul 24 09:51:52.143167592 (131h0m58.515746947s) [upload=104767]: Waiting for error group managing segments... Jul 24 09:51:52.143202719 (131h0m58.515782074s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:51:52.143207468 (131h0m58.515786813s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:51:52.143210043 (131h0m58.515789388s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:51:52.596288812 (131h0m58.968868157s) [upload=104767]: Done uploading segments... Jul 24 09:51:52.596306687 (131h0m58.968886032s) [upload=104767]: Upload finished. err: <nil> Jul 24 09:52:34.688885621 (131h1m41.061464966s) [upload=104775]: Starting upload Jul 24 09:52:34.688938663 (131h1m41.061518018s) [upload=104775]: Done starting upload Jul 24 09:52:34.688983298 (131h1m41.061562653s) [upload=104775]: Uploading segments... Jul 24 09:52:34.689010750 (131h1m41.061590105s) [upload=104775]: Got next segment. Inline: true Jul 24 09:52:34.689014378 (131h1m41.061593733s) [upload=104775]: Waiting for error group managing segments... Jul 24 09:52:34.689050106 (131h1m41.061629461s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:52:34.689054504 (131h1m41.061633849s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:52:34.689058522 (131h1m41.061637877s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:52:34.985853686 (131h1m41.358433031s) [upload=104775]: Done uploading segments... Jul 24 09:52:34.985874075 (131h1m41.35845343s) [upload=104775]: Upload finished. err: <nil> Jul 24 09:53:33.658681752 (131h2m40.031261107s) [upload=104789]: Starting upload Jul 24 09:53:33.658743130 (131h2m40.031322475s) [upload=104789]: Done starting upload Jul 24 09:53:33.658852189 (131h2m40.031431544s) [upload=104789]: Uploading segments... Jul 24 09:53:33.658886614 (131h2m40.031465969s) [upload=104789]: Got next segment. Inline: true Jul 24 09:53:33.658890441 (131h2m40.031469796s) [upload=104789]: Waiting for error group managing segments... Jul 24 09:53:33.658935548 (131h2m40.031514903s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:53:33.658940047 (131h2m40.031519402s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:53:33.658942892 (131h2m40.031522247s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:53:34.044724862 (131h2m40.417304227s) [upload=104789]: Done uploading segments... Jul 24 09:53:34.044748257 (131h2m40.417327612s) [upload=104789]: Upload finished. err: <nil>
Duration: 1.904100238s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.893862339s
FAIL (2025-07-24 09:58:32 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 813s) [upload=104702]: Starting upload Jul 24 09:46:57.683505650 (130h56m4.056085005s) [upload=104702]: Done starting upload Jul 24 09:46:57.683557279 (130h56m4.056136634s) [upload=104702]: Uploading segments... Jul 24 09:46:57.683587847 (130h56m4.056167202s) [upload=104702]: Got next segment. Inline: true Jul 24 09:46:57.683591223 (130h56m4.056170578s) [upload=104702]: Waiting for error group managing segments... Jul 24 09:46:57.683627943 (130h56m4.056207298s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:46:57.683632302 (130h56m4.056211657s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:46:57.683635338 (130h56m4.056214693s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:46:58.027539489 (130h56m4.400118845s) [upload=104702]: Done uploading segments... Jul 24 09:46:58.027555950 (130h56m4.400135305s) [upload=104702]: Upload finished. err: <nil> Jul 24 09:47:14.659060250 (130h56m21.031639595s) [upload=104705]: Starting upload Jul 24 09:47:14.659136015 (130h56m21.03171536s) [upload=104705]: Done starting upload Jul 24 09:47:14.659198274 (130h56m21.031777629s) [upload=104705]: Uploading segments... Jul 24 09:47:14.659234294 (130h56m21.031813639s) [upload=104705]: Got next segment. Inline: true Jul 24 09:47:14.659238311 (130h56m21.031817656s) [upload=104705]: Waiting for error group managing segments... Jul 24 09:47:14.659268970 (130h56m21.031848325s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:14.659273729 (130h56m21.031853084s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:14.659276404 (130h56m21.031855749s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:14.972135203 (130h56m21.344714558s) [upload=104705]: Done uploading segments... Jul 24 09:47:14.972153989 (130h56m21.344733344s) [upload=104705]: Upload finished. err: <nil> Jul 24 09:47:51.417630323 (130h56m57.790209678s) [upload=104714]: Starting upload Jul 24 09:47:51.417696018 (130h56m57.790275373s) [upload=104714]: Done starting upload Jul 24 09:47:51.417758006 (130h56m57.790337361s) [upload=104714]: Uploading segments... Jul 24 09:47:51.417836797 (130h56m57.790416142s) [upload=104714]: Got next segment. Inline: true Jul 24 09:47:51.417841035 (130h56m57.79042039s) [upload=104714]: Waiting for error group managing segments... Jul 24 09:47:51.417877385 (130h56m57.790456741s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:51.417882114 (130h56m57.790461469s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:51.417884579 (130h56m57.790463934s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:51.693929209 (130h56m58.066508564s) [upload=104714]: Done uploading segments... Jul 24 09:47:51.693948486 (130h56m58.066527841s) [upload=104714]: Upload finished. err: <nil> Jul 24 09:48:30.339202112 (130h57m36.711781467s) [upload=104721]: Starting upload Jul 24 09:48:30.339261806 (130h57m36.711841161s) [upload=104721]: Done starting upload Jul 24 09:48:30.339324405 (130h57m36.711903761s) [upload=104721]: Uploading segments... Jul 24 09:48:30.339403888 (130h57m36.711983243s) [upload=104721]: Got next segment. Inline: true Jul 24 09:48:30.339408376 (130h57m36.711987732s) [upload=104721]: Waiting for error group managing segments... Jul 24 09:48:30.339448363 (130h57m36.712027718s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:30.339453262 (130h57m36.712032617s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:30.339455587 (130h57m36.712034942s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:30.640282044 (130h57m37.012861399s) [upload=104721]: Done uploading segments... Jul 24 09:48:30.640296521 (130h57m37.012875876s) [upload=104721]: Upload finished. err: <nil> Jul 24 09:48:46.345209259 (130h57m52.717788615s) [upload=104724]: Starting upload Jul 24 09:48:46.345259656 (130h57m52.717839011s) [upload=104724]: Done starting upload Jul 24 09:48:46.345303189 (130h57m52.717882544s) [upload=104724]: Uploading segments... Jul 24 09:48:46.345377631 (130h57m52.717956987s) [upload=104724]: Got next segment. Inline: true Jul 24 09:48:46.345381759 (130h57m52.717961114s) [upload=104724]: Waiting for error group managing segments... Jul 24 09:48:46.345430032 (130h57m52.718009377s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:46.345438027 (130h57m52.718017382s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:46.345440652 (130h57m52.718020007s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:46.625333176 (130h57m52.997912531s) [upload=104724]: Done uploading segments... Jul 24 09:48:46.625348975 (130h57m52.99792832s) [upload=104724]: Upload finished. err: <nil> Jul 24 09:49:53.971630320 (130h59m0.344209675s) [upload=104740]: Starting upload Jul 24 09:49:53.971686478 (130h59m0.344265833s) [upload=104740]: Done starting upload Jul 24 09:49:53.971735882 (130h59m0.344315237s) [upload=104740]: Uploading segments... Jul 24 09:49:53.971768785 (130h59m0.34434814s) [upload=104740]: Got next segment. Inline: true Jul 24 09:49:53.971772703 (130h59m0.344352058s) [upload=104740]: Waiting for error group managing segments... Jul 24 09:49:53.971805325 (130h59m0.34438468s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:49:53.971810485 (130h59m0.34438984s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:49:53.971813109 (130h59m0.344392465s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:49:54.251260420 (130h59m0.623839765s) [upload=104740]: Done uploading segments... Jul 24 09:49:54.251276872 (130h59m0.623856227s) [upload=104740]: Upload finished. err: <nil> Jul 24 09:50:48.811147701 (130h59m55.183727056s) [upload=104752]: Starting upload Jul 24 09:50:48.811259444 (130h59m55.183838829s) [upload=104752]: Done starting upload Jul 24 09:50:48.811386498 (130h59m55.183965883s) [upload=104752]: Uploading segments... Jul 24 09:50:48.811437335 (130h59m55.18401669s) [upload=104752]: Got next segment. Inline: true Jul 24 09:50:48.811441182 (130h59m55.184020538s) [upload=104752]: Waiting for error group managing segments... Jul 24 09:50:48.811474957 (130h59m55.184054312s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:50:48.811479656 (130h59m55.184059011s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:50:48.811482131 (130h59m55.184061486s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:50:49.085645812 (130h59m55.458225167s) [upload=104752]: Done uploading segments... Jul 24 09:50:49.085664027 (130h59m55.458243382s) [upload=104752]: Upload finished. err: <nil> Jul 24 09:51:52.143001303 (131h0m58.515580658s) [upload=104767]: Starting upload Jul 24 09:51:52.143067560 (131h0m58.515646915s) [upload=104767]: Done starting upload Jul 24 09:51:52.143126222 (131h0m58.515705577s) [upload=104767]: Uploading segments... Jul 24 09:51:52.143163774 (131h0m58.515743129s) [upload=104767]: Got next segment. Inline: true Jul 24 09:51:52.143167592 (131h0m58.515746947s) [upload=104767]: Waiting for error group managing segments... Jul 24 09:51:52.143202719 (131h0m58.515782074s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:51:52.143207468 (131h0m58.515786813s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:51:52.143210043 (131h0m58.515789388s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:51:52.596288812 (131h0m58.968868157s) [upload=104767]: Done uploading segments... Jul 24 09:51:52.596306687 (131h0m58.968886032s) [upload=104767]: Upload finished. err: <nil> Jul 24 09:52:34.688885621 (131h1m41.061464966s) [upload=104775]: Starting upload Jul 24 09:52:34.688938663 (131h1m41.061518018s) [upload=104775]: Done starting upload Jul 24 09:52:34.688983298 (131h1m41.061562653s) [upload=104775]: Uploading segments... Jul 24 09:52:34.689010750 (131h1m41.061590105s) [upload=104775]: Got next segment. Inline: true Jul 24 09:52:34.689014378 (131h1m41.061593733s) [upload=104775]: Waiting for error group managing segments... Jul 24 09:52:34.689050106 (131h1m41.061629461s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:52:34.689054504 (131h1m41.061633849s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:52:34.689058522 (131h1m41.061637877s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:52:34.985853686 (131h1m41.358433031s) [upload=104775]: Done uploading segments... Jul 24 09:52:34.985874075 (131h1m41.35845343s) [upload=104775]: Upload finished. err: <nil> Jul 24 09:53:33.658681752 (131h2m40.031261107s) [upload=104789]: Starting upload Jul 24 09:53:33.658743130 (131h2m40.031322475s) [upload=104789]: Done starting upload Jul 24 09:53:33.658852189 (131h2m40.031431544s) [upload=104789]: Uploading segments... Jul 24 09:53:33.658886614 (131h2m40.031465969s) [upload=104789]: Got next segment. Inline: true Jul 24 09:53:33.658890441 (131h2m40.031469796s) [upload=104789]: Waiting for error group managing segments... Jul 24 09:53:33.658935548 (131h2m40.031514903s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:53:33.658940047 (131h2m40.031519402s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:53:33.658942892 (131h2m40.031522247s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:53:34.044724862 (131h2m40.417304227s) [upload=104789]: Done uploading segments... Jul 24 09:53:34.044748257 (131h2m40.417327612s) [upload=104789]: Upload finished. err: <nil>
Duration: 1.89388874s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.874720546s
FAIL (2025-07-24 09:58:16 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 813s) [upload=104702]: Starting upload Jul 24 09:46:57.683505650 (130h56m4.056085005s) [upload=104702]: Done starting upload Jul 24 09:46:57.683557279 (130h56m4.056136634s) [upload=104702]: Uploading segments... Jul 24 09:46:57.683587847 (130h56m4.056167202s) [upload=104702]: Got next segment. Inline: true Jul 24 09:46:57.683591223 (130h56m4.056170578s) [upload=104702]: Waiting for error group managing segments... Jul 24 09:46:57.683627943 (130h56m4.056207298s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:46:57.683632302 (130h56m4.056211657s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:46:57.683635338 (130h56m4.056214693s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:46:58.027539489 (130h56m4.400118845s) [upload=104702]: Done uploading segments... Jul 24 09:46:58.027555950 (130h56m4.400135305s) [upload=104702]: Upload finished. err: <nil> Jul 24 09:47:14.659060250 (130h56m21.031639595s) [upload=104705]: Starting upload Jul 24 09:47:14.659136015 (130h56m21.03171536s) [upload=104705]: Done starting upload Jul 24 09:47:14.659198274 (130h56m21.031777629s) [upload=104705]: Uploading segments... Jul 24 09:47:14.659234294 (130h56m21.031813639s) [upload=104705]: Got next segment. Inline: true Jul 24 09:47:14.659238311 (130h56m21.031817656s) [upload=104705]: Waiting for error group managing segments... Jul 24 09:47:14.659268970 (130h56m21.031848325s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:14.659273729 (130h56m21.031853084s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:14.659276404 (130h56m21.031855749s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:14.972135203 (130h56m21.344714558s) [upload=104705]: Done uploading segments... Jul 24 09:47:14.972153989 (130h56m21.344733344s) [upload=104705]: Upload finished. err: <nil> Jul 24 09:47:51.417630323 (130h56m57.790209678s) [upload=104714]: Starting upload Jul 24 09:47:51.417696018 (130h56m57.790275373s) [upload=104714]: Done starting upload Jul 24 09:47:51.417758006 (130h56m57.790337361s) [upload=104714]: Uploading segments... Jul 24 09:47:51.417836797 (130h56m57.790416142s) [upload=104714]: Got next segment. Inline: true Jul 24 09:47:51.417841035 (130h56m57.79042039s) [upload=104714]: Waiting for error group managing segments... Jul 24 09:47:51.417877385 (130h56m57.790456741s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:51.417882114 (130h56m57.790461469s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:51.417884579 (130h56m57.790463934s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:51.693929209 (130h56m58.066508564s) [upload=104714]: Done uploading segments... Jul 24 09:47:51.693948486 (130h56m58.066527841s) [upload=104714]: Upload finished. err: <nil> Jul 24 09:48:30.339202112 (130h57m36.711781467s) [upload=104721]: Starting upload Jul 24 09:48:30.339261806 (130h57m36.711841161s) [upload=104721]: Done starting upload Jul 24 09:48:30.339324405 (130h57m36.711903761s) [upload=104721]: Uploading segments... Jul 24 09:48:30.339403888 (130h57m36.711983243s) [upload=104721]: Got next segment. Inline: true Jul 24 09:48:30.339408376 (130h57m36.711987732s) [upload=104721]: Waiting for error group managing segments... Jul 24 09:48:30.339448363 (130h57m36.712027718s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:30.339453262 (130h57m36.712032617s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:30.339455587 (130h57m36.712034942s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:30.640282044 (130h57m37.012861399s) [upload=104721]: Done uploading segments... Jul 24 09:48:30.640296521 (130h57m37.012875876s) [upload=104721]: Upload finished. err: <nil> Jul 24 09:48:46.345209259 (130h57m52.717788615s) [upload=104724]: Starting upload Jul 24 09:48:46.345259656 (130h57m52.717839011s) [upload=104724]: Done starting upload Jul 24 09:48:46.345303189 (130h57m52.717882544s) [upload=104724]: Uploading segments... Jul 24 09:48:46.345377631 (130h57m52.717956987s) [upload=104724]: Got next segment. Inline: true Jul 24 09:48:46.345381759 (130h57m52.717961114s) [upload=104724]: Waiting for error group managing segments... Jul 24 09:48:46.345430032 (130h57m52.718009377s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:46.345438027 (130h57m52.718017382s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:46.345440652 (130h57m52.718020007s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:46.625333176 (130h57m52.997912531s) [upload=104724]: Done uploading segments... Jul 24 09:48:46.625348975 (130h57m52.99792832s) [upload=104724]: Upload finished. err: <nil> Jul 24 09:49:53.971630320 (130h59m0.344209675s) [upload=104740]: Starting upload Jul 24 09:49:53.971686478 (130h59m0.344265833s) [upload=104740]: Done starting upload Jul 24 09:49:53.971735882 (130h59m0.344315237s) [upload=104740]: Uploading segments... Jul 24 09:49:53.971768785 (130h59m0.34434814s) [upload=104740]: Got next segment. Inline: true Jul 24 09:49:53.971772703 (130h59m0.344352058s) [upload=104740]: Waiting for error group managing segments... Jul 24 09:49:53.971805325 (130h59m0.34438468s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:49:53.971810485 (130h59m0.34438984s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:49:53.971813109 (130h59m0.344392465s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:49:54.251260420 (130h59m0.623839765s) [upload=104740]: Done uploading segments... Jul 24 09:49:54.251276872 (130h59m0.623856227s) [upload=104740]: Upload finished. err: <nil> Jul 24 09:50:48.811147701 (130h59m55.183727056s) [upload=104752]: Starting upload Jul 24 09:50:48.811259444 (130h59m55.183838829s) [upload=104752]: Done starting upload Jul 24 09:50:48.811386498 (130h59m55.183965883s) [upload=104752]: Uploading segments... Jul 24 09:50:48.811437335 (130h59m55.18401669s) [upload=104752]: Got next segment. Inline: true Jul 24 09:50:48.811441182 (130h59m55.184020538s) [upload=104752]: Waiting for error group managing segments... Jul 24 09:50:48.811474957 (130h59m55.184054312s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:50:48.811479656 (130h59m55.184059011s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:50:48.811482131 (130h59m55.184061486s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:50:49.085645812 (130h59m55.458225167s) [upload=104752]: Done uploading segments... Jul 24 09:50:49.085664027 (130h59m55.458243382s) [upload=104752]: Upload finished. err: <nil> Jul 24 09:51:52.143001303 (131h0m58.515580658s) [upload=104767]: Starting upload Jul 24 09:51:52.143067560 (131h0m58.515646915s) [upload=104767]: Done starting upload Jul 24 09:51:52.143126222 (131h0m58.515705577s) [upload=104767]: Uploading segments... Jul 24 09:51:52.143163774 (131h0m58.515743129s) [upload=104767]: Got next segment. Inline: true Jul 24 09:51:52.143167592 (131h0m58.515746947s) [upload=104767]: Waiting for error group managing segments... Jul 24 09:51:52.143202719 (131h0m58.515782074s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:51:52.143207468 (131h0m58.515786813s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:51:52.143210043 (131h0m58.515789388s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:51:52.596288812 (131h0m58.968868157s) [upload=104767]: Done uploading segments... Jul 24 09:51:52.596306687 (131h0m58.968886032s) [upload=104767]: Upload finished. err: <nil> Jul 24 09:52:34.688885621 (131h1m41.061464966s) [upload=104775]: Starting upload Jul 24 09:52:34.688938663 (131h1m41.061518018s) [upload=104775]: Done starting upload Jul 24 09:52:34.688983298 (131h1m41.061562653s) [upload=104775]: Uploading segments... Jul 24 09:52:34.689010750 (131h1m41.061590105s) [upload=104775]: Got next segment. Inline: true Jul 24 09:52:34.689014378 (131h1m41.061593733s) [upload=104775]: Waiting for error group managing segments... Jul 24 09:52:34.689050106 (131h1m41.061629461s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:52:34.689054504 (131h1m41.061633849s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:52:34.689058522 (131h1m41.061637877s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:52:34.985853686 (131h1m41.358433031s) [upload=104775]: Done uploading segments... Jul 24 09:52:34.985874075 (131h1m41.35845343s) [upload=104775]: Upload finished. err: <nil> Jul 24 09:53:33.658681752 (131h2m40.031261107s) [upload=104789]: Starting upload Jul 24 09:53:33.658743130 (131h2m40.031322475s) [upload=104789]: Done starting upload Jul 24 09:53:33.658852189 (131h2m40.031431544s) [upload=104789]: Uploading segments... Jul 24 09:53:33.658886614 (131h2m40.031465969s) [upload=104789]: Got next segment. Inline: true Jul 24 09:53:33.658890441 (131h2m40.031469796s) [upload=104789]: Waiting for error group managing segments... Jul 24 09:53:33.658935548 (131h2m40.031514903s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:53:33.658940047 (131h2m40.031519402s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:53:33.658942892 (131h2m40.031522247s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:53:34.044724862 (131h2m40.417304227s) [upload=104789]: Done uploading segments... Jul 24 09:53:34.044748257 (131h2m40.417327612s) [upload=104789]: Upload finished. err: <nil>
Duration: 1.874747296s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.950747015s
FAIL (2025-07-24 09:57:33 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 813s) [upload=104702]: Starting upload Jul 24 09:46:57.683505650 (130h56m4.056085005s) [upload=104702]: Done starting upload Jul 24 09:46:57.683557279 (130h56m4.056136634s) [upload=104702]: Uploading segments... Jul 24 09:46:57.683587847 (130h56m4.056167202s) [upload=104702]: Got next segment. Inline: true Jul 24 09:46:57.683591223 (130h56m4.056170578s) [upload=104702]: Waiting for error group managing segments... Jul 24 09:46:57.683627943 (130h56m4.056207298s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:46:57.683632302 (130h56m4.056211657s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:46:57.683635338 (130h56m4.056214693s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:46:58.027539489 (130h56m4.400118845s) [upload=104702]: Done uploading segments... Jul 24 09:46:58.027555950 (130h56m4.400135305s) [upload=104702]: Upload finished. err: <nil> Jul 24 09:47:14.659060250 (130h56m21.031639595s) [upload=104705]: Starting upload Jul 24 09:47:14.659136015 (130h56m21.03171536s) [upload=104705]: Done starting upload Jul 24 09:47:14.659198274 (130h56m21.031777629s) [upload=104705]: Uploading segments... Jul 24 09:47:14.659234294 (130h56m21.031813639s) [upload=104705]: Got next segment. Inline: true Jul 24 09:47:14.659238311 (130h56m21.031817656s) [upload=104705]: Waiting for error group managing segments... Jul 24 09:47:14.659268970 (130h56m21.031848325s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:14.659273729 (130h56m21.031853084s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:14.659276404 (130h56m21.031855749s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:14.972135203 (130h56m21.344714558s) [upload=104705]: Done uploading segments... Jul 24 09:47:14.972153989 (130h56m21.344733344s) [upload=104705]: Upload finished. err: <nil> Jul 24 09:47:51.417630323 (130h56m57.790209678s) [upload=104714]: Starting upload Jul 24 09:47:51.417696018 (130h56m57.790275373s) [upload=104714]: Done starting upload Jul 24 09:47:51.417758006 (130h56m57.790337361s) [upload=104714]: Uploading segments... Jul 24 09:47:51.417836797 (130h56m57.790416142s) [upload=104714]: Got next segment. Inline: true Jul 24 09:47:51.417841035 (130h56m57.79042039s) [upload=104714]: Waiting for error group managing segments... Jul 24 09:47:51.417877385 (130h56m57.790456741s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:51.417882114 (130h56m57.790461469s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:51.417884579 (130h56m57.790463934s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:51.693929209 (130h56m58.066508564s) [upload=104714]: Done uploading segments... Jul 24 09:47:51.693948486 (130h56m58.066527841s) [upload=104714]: Upload finished. err: <nil> Jul 24 09:48:30.339202112 (130h57m36.711781467s) [upload=104721]: Starting upload Jul 24 09:48:30.339261806 (130h57m36.711841161s) [upload=104721]: Done starting upload Jul 24 09:48:30.339324405 (130h57m36.711903761s) [upload=104721]: Uploading segments... Jul 24 09:48:30.339403888 (130h57m36.711983243s) [upload=104721]: Got next segment. Inline: true Jul 24 09:48:30.339408376 (130h57m36.711987732s) [upload=104721]: Waiting for error group managing segments... Jul 24 09:48:30.339448363 (130h57m36.712027718s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:30.339453262 (130h57m36.712032617s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:30.339455587 (130h57m36.712034942s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:30.640282044 (130h57m37.012861399s) [upload=104721]: Done uploading segments... Jul 24 09:48:30.640296521 (130h57m37.012875876s) [upload=104721]: Upload finished. err: <nil> Jul 24 09:48:46.345209259 (130h57m52.717788615s) [upload=104724]: Starting upload Jul 24 09:48:46.345259656 (130h57m52.717839011s) [upload=104724]: Done starting upload Jul 24 09:48:46.345303189 (130h57m52.717882544s) [upload=104724]: Uploading segments... Jul 24 09:48:46.345377631 (130h57m52.717956987s) [upload=104724]: Got next segment. Inline: true Jul 24 09:48:46.345381759 (130h57m52.717961114s) [upload=104724]: Waiting for error group managing segments... Jul 24 09:48:46.345430032 (130h57m52.718009377s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:46.345438027 (130h57m52.718017382s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:46.345440652 (130h57m52.718020007s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:46.625333176 (130h57m52.997912531s) [upload=104724]: Done uploading segments... Jul 24 09:48:46.625348975 (130h57m52.99792832s) [upload=104724]: Upload finished. err: <nil> Jul 24 09:49:53.971630320 (130h59m0.344209675s) [upload=104740]: Starting upload Jul 24 09:49:53.971686478 (130h59m0.344265833s) [upload=104740]: Done starting upload Jul 24 09:49:53.971735882 (130h59m0.344315237s) [upload=104740]: Uploading segments... Jul 24 09:49:53.971768785 (130h59m0.34434814s) [upload=104740]: Got next segment. Inline: true Jul 24 09:49:53.971772703 (130h59m0.344352058s) [upload=104740]: Waiting for error group managing segments... Jul 24 09:49:53.971805325 (130h59m0.34438468s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:49:53.971810485 (130h59m0.34438984s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:49:53.971813109 (130h59m0.344392465s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:49:54.251260420 (130h59m0.623839765s) [upload=104740]: Done uploading segments... Jul 24 09:49:54.251276872 (130h59m0.623856227s) [upload=104740]: Upload finished. err: <nil> Jul 24 09:50:48.811147701 (130h59m55.183727056s) [upload=104752]: Starting upload Jul 24 09:50:48.811259444 (130h59m55.183838829s) [upload=104752]: Done starting upload Jul 24 09:50:48.811386498 (130h59m55.183965883s) [upload=104752]: Uploading segments... Jul 24 09:50:48.811437335 (130h59m55.18401669s) [upload=104752]: Got next segment. Inline: true Jul 24 09:50:48.811441182 (130h59m55.184020538s) [upload=104752]: Waiting for error group managing segments... Jul 24 09:50:48.811474957 (130h59m55.184054312s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:50:48.811479656 (130h59m55.184059011s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:50:48.811482131 (130h59m55.184061486s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:50:49.085645812 (130h59m55.458225167s) [upload=104752]: Done uploading segments... Jul 24 09:50:49.085664027 (130h59m55.458243382s) [upload=104752]: Upload finished. err: <nil> Jul 24 09:51:52.143001303 (131h0m58.515580658s) [upload=104767]: Starting upload Jul 24 09:51:52.143067560 (131h0m58.515646915s) [upload=104767]: Done starting upload Jul 24 09:51:52.143126222 (131h0m58.515705577s) [upload=104767]: Uploading segments... Jul 24 09:51:52.143163774 (131h0m58.515743129s) [upload=104767]: Got next segment. Inline: true Jul 24 09:51:52.143167592 (131h0m58.515746947s) [upload=104767]: Waiting for error group managing segments... Jul 24 09:51:52.143202719 (131h0m58.515782074s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:51:52.143207468 (131h0m58.515786813s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:51:52.143210043 (131h0m58.515789388s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:51:52.596288812 (131h0m58.968868157s) [upload=104767]: Done uploading segments... Jul 24 09:51:52.596306687 (131h0m58.968886032s) [upload=104767]: Upload finished. err: <nil> Jul 24 09:52:34.688885621 (131h1m41.061464966s) [upload=104775]: Starting upload Jul 24 09:52:34.688938663 (131h1m41.061518018s) [upload=104775]: Done starting upload Jul 24 09:52:34.688983298 (131h1m41.061562653s) [upload=104775]: Uploading segments... Jul 24 09:52:34.689010750 (131h1m41.061590105s) [upload=104775]: Got next segment. Inline: true Jul 24 09:52:34.689014378 (131h1m41.061593733s) [upload=104775]: Waiting for error group managing segments... Jul 24 09:52:34.689050106 (131h1m41.061629461s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:52:34.689054504 (131h1m41.061633849s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:52:34.689058522 (131h1m41.061637877s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:52:34.985853686 (131h1m41.358433031s) [upload=104775]: Done uploading segments... Jul 24 09:52:34.985874075 (131h1m41.35845343s) [upload=104775]: Upload finished. err: <nil> Jul 24 09:53:33.658681752 (131h2m40.031261107s) [upload=104789]: Starting upload Jul 24 09:53:33.658743130 (131h2m40.031322475s) [upload=104789]: Done starting upload Jul 24 09:53:33.658852189 (131h2m40.031431544s) [upload=104789]: Uploading segments... Jul 24 09:53:33.658886614 (131h2m40.031465969s) [upload=104789]: Got next segment. Inline: true Jul 24 09:53:33.658890441 (131h2m40.031469796s) [upload=104789]: Waiting for error group managing segments... Jul 24 09:53:33.658935548 (131h2m40.031514903s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:53:33.658940047 (131h2m40.031519402s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:53:33.658942892 (131h2m40.031522247s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:53:34.044724862 (131h2m40.417304227s) [upload=104789]: Done uploading segments... Jul 24 09:53:34.044748257 (131h2m40.417327612s) [upload=104789]: Upload finished. err: <nil>
Duration: 1.950771491s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.898001049s
FAIL (2025-07-24 09:56:49 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 813s) [upload=104702]: Starting upload Jul 24 09:46:57.683505650 (130h56m4.056085005s) [upload=104702]: Done starting upload Jul 24 09:46:57.683557279 (130h56m4.056136634s) [upload=104702]: Uploading segments... Jul 24 09:46:57.683587847 (130h56m4.056167202s) [upload=104702]: Got next segment. Inline: true Jul 24 09:46:57.683591223 (130h56m4.056170578s) [upload=104702]: Waiting for error group managing segments... Jul 24 09:46:57.683627943 (130h56m4.056207298s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:46:57.683632302 (130h56m4.056211657s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:46:57.683635338 (130h56m4.056214693s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:46:58.027539489 (130h56m4.400118845s) [upload=104702]: Done uploading segments... Jul 24 09:46:58.027555950 (130h56m4.400135305s) [upload=104702]: Upload finished. err: <nil> Jul 24 09:47:14.659060250 (130h56m21.031639595s) [upload=104705]: Starting upload Jul 24 09:47:14.659136015 (130h56m21.03171536s) [upload=104705]: Done starting upload Jul 24 09:47:14.659198274 (130h56m21.031777629s) [upload=104705]: Uploading segments... Jul 24 09:47:14.659234294 (130h56m21.031813639s) [upload=104705]: Got next segment. Inline: true Jul 24 09:47:14.659238311 (130h56m21.031817656s) [upload=104705]: Waiting for error group managing segments... Jul 24 09:47:14.659268970 (130h56m21.031848325s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:14.659273729 (130h56m21.031853084s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:14.659276404 (130h56m21.031855749s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:14.972135203 (130h56m21.344714558s) [upload=104705]: Done uploading segments... Jul 24 09:47:14.972153989 (130h56m21.344733344s) [upload=104705]: Upload finished. err: <nil> Jul 24 09:47:51.417630323 (130h56m57.790209678s) [upload=104714]: Starting upload Jul 24 09:47:51.417696018 (130h56m57.790275373s) [upload=104714]: Done starting upload Jul 24 09:47:51.417758006 (130h56m57.790337361s) [upload=104714]: Uploading segments... Jul 24 09:47:51.417836797 (130h56m57.790416142s) [upload=104714]: Got next segment. Inline: true Jul 24 09:47:51.417841035 (130h56m57.79042039s) [upload=104714]: Waiting for error group managing segments... Jul 24 09:47:51.417877385 (130h56m57.790456741s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:51.417882114 (130h56m57.790461469s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:51.417884579 (130h56m57.790463934s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:51.693929209 (130h56m58.066508564s) [upload=104714]: Done uploading segments... Jul 24 09:47:51.693948486 (130h56m58.066527841s) [upload=104714]: Upload finished. err: <nil> Jul 24 09:48:30.339202112 (130h57m36.711781467s) [upload=104721]: Starting upload Jul 24 09:48:30.339261806 (130h57m36.711841161s) [upload=104721]: Done starting upload Jul 24 09:48:30.339324405 (130h57m36.711903761s) [upload=104721]: Uploading segments... Jul 24 09:48:30.339403888 (130h57m36.711983243s) [upload=104721]: Got next segment. Inline: true Jul 24 09:48:30.339408376 (130h57m36.711987732s) [upload=104721]: Waiting for error group managing segments... Jul 24 09:48:30.339448363 (130h57m36.712027718s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:30.339453262 (130h57m36.712032617s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:30.339455587 (130h57m36.712034942s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:30.640282044 (130h57m37.012861399s) [upload=104721]: Done uploading segments... Jul 24 09:48:30.640296521 (130h57m37.012875876s) [upload=104721]: Upload finished. err: <nil> Jul 24 09:48:46.345209259 (130h57m52.717788615s) [upload=104724]: Starting upload Jul 24 09:48:46.345259656 (130h57m52.717839011s) [upload=104724]: Done starting upload Jul 24 09:48:46.345303189 (130h57m52.717882544s) [upload=104724]: Uploading segments... Jul 24 09:48:46.345377631 (130h57m52.717956987s) [upload=104724]: Got next segment. Inline: true Jul 24 09:48:46.345381759 (130h57m52.717961114s) [upload=104724]: Waiting for error group managing segments... Jul 24 09:48:46.345430032 (130h57m52.718009377s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:46.345438027 (130h57m52.718017382s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:46.345440652 (130h57m52.718020007s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:46.625333176 (130h57m52.997912531s) [upload=104724]: Done uploading segments... Jul 24 09:48:46.625348975 (130h57m52.99792832s) [upload=104724]: Upload finished. err: <nil> Jul 24 09:49:53.971630320 (130h59m0.344209675s) [upload=104740]: Starting upload Jul 24 09:49:53.971686478 (130h59m0.344265833s) [upload=104740]: Done starting upload Jul 24 09:49:53.971735882 (130h59m0.344315237s) [upload=104740]: Uploading segments... Jul 24 09:49:53.971768785 (130h59m0.34434814s) [upload=104740]: Got next segment. Inline: true Jul 24 09:49:53.971772703 (130h59m0.344352058s) [upload=104740]: Waiting for error group managing segments... Jul 24 09:49:53.971805325 (130h59m0.34438468s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:49:53.971810485 (130h59m0.34438984s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:49:53.971813109 (130h59m0.344392465s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:49:54.251260420 (130h59m0.623839765s) [upload=104740]: Done uploading segments... Jul 24 09:49:54.251276872 (130h59m0.623856227s) [upload=104740]: Upload finished. err: <nil> Jul 24 09:50:48.811147701 (130h59m55.183727056s) [upload=104752]: Starting upload Jul 24 09:50:48.811259444 (130h59m55.183838829s) [upload=104752]: Done starting upload Jul 24 09:50:48.811386498 (130h59m55.183965883s) [upload=104752]: Uploading segments... Jul 24 09:50:48.811437335 (130h59m55.18401669s) [upload=104752]: Got next segment. Inline: true Jul 24 09:50:48.811441182 (130h59m55.184020538s) [upload=104752]: Waiting for error group managing segments... Jul 24 09:50:48.811474957 (130h59m55.184054312s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:50:48.811479656 (130h59m55.184059011s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:50:48.811482131 (130h59m55.184061486s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:50:49.085645812 (130h59m55.458225167s) [upload=104752]: Done uploading segments... Jul 24 09:50:49.085664027 (130h59m55.458243382s) [upload=104752]: Upload finished. err: <nil> Jul 24 09:51:52.143001303 (131h0m58.515580658s) [upload=104767]: Starting upload Jul 24 09:51:52.143067560 (131h0m58.515646915s) [upload=104767]: Done starting upload Jul 24 09:51:52.143126222 (131h0m58.515705577s) [upload=104767]: Uploading segments... Jul 24 09:51:52.143163774 (131h0m58.515743129s) [upload=104767]: Got next segment. Inline: true Jul 24 09:51:52.143167592 (131h0m58.515746947s) [upload=104767]: Waiting for error group managing segments... Jul 24 09:51:52.143202719 (131h0m58.515782074s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:51:52.143207468 (131h0m58.515786813s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:51:52.143210043 (131h0m58.515789388s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:51:52.596288812 (131h0m58.968868157s) [upload=104767]: Done uploading segments... Jul 24 09:51:52.596306687 (131h0m58.968886032s) [upload=104767]: Upload finished. err: <nil> Jul 24 09:52:34.688885621 (131h1m41.061464966s) [upload=104775]: Starting upload Jul 24 09:52:34.688938663 (131h1m41.061518018s) [upload=104775]: Done starting upload Jul 24 09:52:34.688983298 (131h1m41.061562653s) [upload=104775]: Uploading segments... Jul 24 09:52:34.689010750 (131h1m41.061590105s) [upload=104775]: Got next segment. Inline: true Jul 24 09:52:34.689014378 (131h1m41.061593733s) [upload=104775]: Waiting for error group managing segments... Jul 24 09:52:34.689050106 (131h1m41.061629461s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:52:34.689054504 (131h1m41.061633849s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:52:34.689058522 (131h1m41.061637877s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:52:34.985853686 (131h1m41.358433031s) [upload=104775]: Done uploading segments... Jul 24 09:52:34.985874075 (131h1m41.35845343s) [upload=104775]: Upload finished. err: <nil> Jul 24 09:53:33.658681752 (131h2m40.031261107s) [upload=104789]: Starting upload Jul 24 09:53:33.658743130 (131h2m40.031322475s) [upload=104789]: Done starting upload Jul 24 09:53:33.658852189 (131h2m40.031431544s) [upload=104789]: Uploading segments... Jul 24 09:53:33.658886614 (131h2m40.031465969s) [upload=104789]: Got next segment. Inline: true Jul 24 09:53:33.658890441 (131h2m40.031469796s) [upload=104789]: Waiting for error group managing segments... Jul 24 09:53:33.658935548 (131h2m40.031514903s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:53:33.658940047 (131h2m40.031519402s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:53:33.658942892 (131h2m40.031522247s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:53:34.044724862 (131h2m40.417304227s) [upload=104789]: Done uploading segments... Jul 24 09:53:34.044748257 (131h2m40.417327612s) [upload=104789]: Upload finished. err: <nil>
Duration: 1.898030195s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.938794197s
FAIL (2025-07-24 09:56:09 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 813s) [upload=104702]: Starting upload Jul 24 09:46:57.683505650 (130h56m4.056085005s) [upload=104702]: Done starting upload Jul 24 09:46:57.683557279 (130h56m4.056136634s) [upload=104702]: Uploading segments... Jul 24 09:46:57.683587847 (130h56m4.056167202s) [upload=104702]: Got next segment. Inline: true Jul 24 09:46:57.683591223 (130h56m4.056170578s) [upload=104702]: Waiting for error group managing segments... Jul 24 09:46:57.683627943 (130h56m4.056207298s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:46:57.683632302 (130h56m4.056211657s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:46:57.683635338 (130h56m4.056214693s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:46:58.027539489 (130h56m4.400118845s) [upload=104702]: Done uploading segments... Jul 24 09:46:58.027555950 (130h56m4.400135305s) [upload=104702]: Upload finished. err: <nil> Jul 24 09:47:14.659060250 (130h56m21.031639595s) [upload=104705]: Starting upload Jul 24 09:47:14.659136015 (130h56m21.03171536s) [upload=104705]: Done starting upload Jul 24 09:47:14.659198274 (130h56m21.031777629s) [upload=104705]: Uploading segments... Jul 24 09:47:14.659234294 (130h56m21.031813639s) [upload=104705]: Got next segment. Inline: true Jul 24 09:47:14.659238311 (130h56m21.031817656s) [upload=104705]: Waiting for error group managing segments... Jul 24 09:47:14.659268970 (130h56m21.031848325s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:14.659273729 (130h56m21.031853084s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:14.659276404 (130h56m21.031855749s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:14.972135203 (130h56m21.344714558s) [upload=104705]: Done uploading segments... Jul 24 09:47:14.972153989 (130h56m21.344733344s) [upload=104705]: Upload finished. err: <nil> Jul 24 09:47:51.417630323 (130h56m57.790209678s) [upload=104714]: Starting upload Jul 24 09:47:51.417696018 (130h56m57.790275373s) [upload=104714]: Done starting upload Jul 24 09:47:51.417758006 (130h56m57.790337361s) [upload=104714]: Uploading segments... Jul 24 09:47:51.417836797 (130h56m57.790416142s) [upload=104714]: Got next segment. Inline: true Jul 24 09:47:51.417841035 (130h56m57.79042039s) [upload=104714]: Waiting for error group managing segments... Jul 24 09:47:51.417877385 (130h56m57.790456741s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:51.417882114 (130h56m57.790461469s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:51.417884579 (130h56m57.790463934s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:51.693929209 (130h56m58.066508564s) [upload=104714]: Done uploading segments... Jul 24 09:47:51.693948486 (130h56m58.066527841s) [upload=104714]: Upload finished. err: <nil> Jul 24 09:48:30.339202112 (130h57m36.711781467s) [upload=104721]: Starting upload Jul 24 09:48:30.339261806 (130h57m36.711841161s) [upload=104721]: Done starting upload Jul 24 09:48:30.339324405 (130h57m36.711903761s) [upload=104721]: Uploading segments... Jul 24 09:48:30.339403888 (130h57m36.711983243s) [upload=104721]: Got next segment. Inline: true Jul 24 09:48:30.339408376 (130h57m36.711987732s) [upload=104721]: Waiting for error group managing segments... Jul 24 09:48:30.339448363 (130h57m36.712027718s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:30.339453262 (130h57m36.712032617s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:30.339455587 (130h57m36.712034942s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:30.640282044 (130h57m37.012861399s) [upload=104721]: Done uploading segments... Jul 24 09:48:30.640296521 (130h57m37.012875876s) [upload=104721]: Upload finished. err: <nil> Jul 24 09:48:46.345209259 (130h57m52.717788615s) [upload=104724]: Starting upload Jul 24 09:48:46.345259656 (130h57m52.717839011s) [upload=104724]: Done starting upload Jul 24 09:48:46.345303189 (130h57m52.717882544s) [upload=104724]: Uploading segments... Jul 24 09:48:46.345377631 (130h57m52.717956987s) [upload=104724]: Got next segment. Inline: true Jul 24 09:48:46.345381759 (130h57m52.717961114s) [upload=104724]: Waiting for error group managing segments... Jul 24 09:48:46.345430032 (130h57m52.718009377s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:46.345438027 (130h57m52.718017382s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:46.345440652 (130h57m52.718020007s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:46.625333176 (130h57m52.997912531s) [upload=104724]: Done uploading segments... Jul 24 09:48:46.625348975 (130h57m52.99792832s) [upload=104724]: Upload finished. err: <nil> Jul 24 09:49:53.971630320 (130h59m0.344209675s) [upload=104740]: Starting upload Jul 24 09:49:53.971686478 (130h59m0.344265833s) [upload=104740]: Done starting upload Jul 24 09:49:53.971735882 (130h59m0.344315237s) [upload=104740]: Uploading segments... Jul 24 09:49:53.971768785 (130h59m0.34434814s) [upload=104740]: Got next segment. Inline: true Jul 24 09:49:53.971772703 (130h59m0.344352058s) [upload=104740]: Waiting for error group managing segments... Jul 24 09:49:53.971805325 (130h59m0.34438468s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:49:53.971810485 (130h59m0.34438984s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:49:53.971813109 (130h59m0.344392465s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:49:54.251260420 (130h59m0.623839765s) [upload=104740]: Done uploading segments... Jul 24 09:49:54.251276872 (130h59m0.623856227s) [upload=104740]: Upload finished. err: <nil> Jul 24 09:50:48.811147701 (130h59m55.183727056s) [upload=104752]: Starting upload Jul 24 09:50:48.811259444 (130h59m55.183838829s) [upload=104752]: Done starting upload Jul 24 09:50:48.811386498 (130h59m55.183965883s) [upload=104752]: Uploading segments... Jul 24 09:50:48.811437335 (130h59m55.18401669s) [upload=104752]: Got next segment. Inline: true Jul 24 09:50:48.811441182 (130h59m55.184020538s) [upload=104752]: Waiting for error group managing segments... Jul 24 09:50:48.811474957 (130h59m55.184054312s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:50:48.811479656 (130h59m55.184059011s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:50:48.811482131 (130h59m55.184061486s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:50:49.085645812 (130h59m55.458225167s) [upload=104752]: Done uploading segments... Jul 24 09:50:49.085664027 (130h59m55.458243382s) [upload=104752]: Upload finished. err: <nil> Jul 24 09:51:52.143001303 (131h0m58.515580658s) [upload=104767]: Starting upload Jul 24 09:51:52.143067560 (131h0m58.515646915s) [upload=104767]: Done starting upload Jul 24 09:51:52.143126222 (131h0m58.515705577s) [upload=104767]: Uploading segments... Jul 24 09:51:52.143163774 (131h0m58.515743129s) [upload=104767]: Got next segment. Inline: true Jul 24 09:51:52.143167592 (131h0m58.515746947s) [upload=104767]: Waiting for error group managing segments... Jul 24 09:51:52.143202719 (131h0m58.515782074s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:51:52.143207468 (131h0m58.515786813s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:51:52.143210043 (131h0m58.515789388s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:51:52.596288812 (131h0m58.968868157s) [upload=104767]: Done uploading segments... Jul 24 09:51:52.596306687 (131h0m58.968886032s) [upload=104767]: Upload finished. err: <nil> Jul 24 09:52:34.688885621 (131h1m41.061464966s) [upload=104775]: Starting upload Jul 24 09:52:34.688938663 (131h1m41.061518018s) [upload=104775]: Done starting upload Jul 24 09:52:34.688983298 (131h1m41.061562653s) [upload=104775]: Uploading segments... Jul 24 09:52:34.689010750 (131h1m41.061590105s) [upload=104775]: Got next segment. Inline: true Jul 24 09:52:34.689014378 (131h1m41.061593733s) [upload=104775]: Waiting for error group managing segments... Jul 24 09:52:34.689050106 (131h1m41.061629461s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:52:34.689054504 (131h1m41.061633849s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:52:34.689058522 (131h1m41.061637877s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:52:34.985853686 (131h1m41.358433031s) [upload=104775]: Done uploading segments... Jul 24 09:52:34.985874075 (131h1m41.35845343s) [upload=104775]: Upload finished. err: <nil> Jul 24 09:53:33.658681752 (131h2m40.031261107s) [upload=104789]: Starting upload Jul 24 09:53:33.658743130 (131h2m40.031322475s) [upload=104789]: Done starting upload Jul 24 09:53:33.658852189 (131h2m40.031431544s) [upload=104789]: Uploading segments... Jul 24 09:53:33.658886614 (131h2m40.031465969s) [upload=104789]: Got next segment. Inline: true Jul 24 09:53:33.658890441 (131h2m40.031469796s) [upload=104789]: Waiting for error group managing segments... Jul 24 09:53:33.658935548 (131h2m40.031514903s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:53:33.658940047 (131h2m40.031519402s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:53:33.658942892 (131h2m40.031522247s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:53:34.044724862 (131h2m40.417304227s) [upload=104789]: Done uploading segments... Jul 24 09:53:34.044748257 (131h2m40.417327612s) [upload=104789]: Upload finished. err: <nil>
Duration: 1.938820788s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.940271675s
FAIL (2025-07-24 09:55:11 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 813s) [upload=104702]: Starting upload Jul 24 09:46:57.683505650 (130h56m4.056085005s) [upload=104702]: Done starting upload Jul 24 09:46:57.683557279 (130h56m4.056136634s) [upload=104702]: Uploading segments... Jul 24 09:46:57.683587847 (130h56m4.056167202s) [upload=104702]: Got next segment. Inline: true Jul 24 09:46:57.683591223 (130h56m4.056170578s) [upload=104702]: Waiting for error group managing segments... Jul 24 09:46:57.683627943 (130h56m4.056207298s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:46:57.683632302 (130h56m4.056211657s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:46:57.683635338 (130h56m4.056214693s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:46:58.027539489 (130h56m4.400118845s) [upload=104702]: Done uploading segments... Jul 24 09:46:58.027555950 (130h56m4.400135305s) [upload=104702]: Upload finished. err: <nil> Jul 24 09:47:14.659060250 (130h56m21.031639595s) [upload=104705]: Starting upload Jul 24 09:47:14.659136015 (130h56m21.03171536s) [upload=104705]: Done starting upload Jul 24 09:47:14.659198274 (130h56m21.031777629s) [upload=104705]: Uploading segments... Jul 24 09:47:14.659234294 (130h56m21.031813639s) [upload=104705]: Got next segment. Inline: true Jul 24 09:47:14.659238311 (130h56m21.031817656s) [upload=104705]: Waiting for error group managing segments... Jul 24 09:47:14.659268970 (130h56m21.031848325s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:14.659273729 (130h56m21.031853084s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:14.659276404 (130h56m21.031855749s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:14.972135203 (130h56m21.344714558s) [upload=104705]: Done uploading segments... Jul 24 09:47:14.972153989 (130h56m21.344733344s) [upload=104705]: Upload finished. err: <nil> Jul 24 09:47:51.417630323 (130h56m57.790209678s) [upload=104714]: Starting upload Jul 24 09:47:51.417696018 (130h56m57.790275373s) [upload=104714]: Done starting upload Jul 24 09:47:51.417758006 (130h56m57.790337361s) [upload=104714]: Uploading segments... Jul 24 09:47:51.417836797 (130h56m57.790416142s) [upload=104714]: Got next segment. Inline: true Jul 24 09:47:51.417841035 (130h56m57.79042039s) [upload=104714]: Waiting for error group managing segments... Jul 24 09:47:51.417877385 (130h56m57.790456741s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:51.417882114 (130h56m57.790461469s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:51.417884579 (130h56m57.790463934s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:51.693929209 (130h56m58.066508564s) [upload=104714]: Done uploading segments... Jul 24 09:47:51.693948486 (130h56m58.066527841s) [upload=104714]: Upload finished. err: <nil> Jul 24 09:48:30.339202112 (130h57m36.711781467s) [upload=104721]: Starting upload Jul 24 09:48:30.339261806 (130h57m36.711841161s) [upload=104721]: Done starting upload Jul 24 09:48:30.339324405 (130h57m36.711903761s) [upload=104721]: Uploading segments... Jul 24 09:48:30.339403888 (130h57m36.711983243s) [upload=104721]: Got next segment. Inline: true Jul 24 09:48:30.339408376 (130h57m36.711987732s) [upload=104721]: Waiting for error group managing segments... Jul 24 09:48:30.339448363 (130h57m36.712027718s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:30.339453262 (130h57m36.712032617s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:30.339455587 (130h57m36.712034942s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:30.640282044 (130h57m37.012861399s) [upload=104721]: Done uploading segments... Jul 24 09:48:30.640296521 (130h57m37.012875876s) [upload=104721]: Upload finished. err: <nil> Jul 24 09:48:46.345209259 (130h57m52.717788615s) [upload=104724]: Starting upload Jul 24 09:48:46.345259656 (130h57m52.717839011s) [upload=104724]: Done starting upload Jul 24 09:48:46.345303189 (130h57m52.717882544s) [upload=104724]: Uploading segments... Jul 24 09:48:46.345377631 (130h57m52.717956987s) [upload=104724]: Got next segment. Inline: true Jul 24 09:48:46.345381759 (130h57m52.717961114s) [upload=104724]: Waiting for error group managing segments... Jul 24 09:48:46.345430032 (130h57m52.718009377s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:46.345438027 (130h57m52.718017382s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:46.345440652 (130h57m52.718020007s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:46.625333176 (130h57m52.997912531s) [upload=104724]: Done uploading segments... Jul 24 09:48:46.625348975 (130h57m52.99792832s) [upload=104724]: Upload finished. err: <nil> Jul 24 09:49:53.971630320 (130h59m0.344209675s) [upload=104740]: Starting upload Jul 24 09:49:53.971686478 (130h59m0.344265833s) [upload=104740]: Done starting upload Jul 24 09:49:53.971735882 (130h59m0.344315237s) [upload=104740]: Uploading segments... Jul 24 09:49:53.971768785 (130h59m0.34434814s) [upload=104740]: Got next segment. Inline: true Jul 24 09:49:53.971772703 (130h59m0.344352058s) [upload=104740]: Waiting for error group managing segments... Jul 24 09:49:53.971805325 (130h59m0.34438468s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:49:53.971810485 (130h59m0.34438984s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:49:53.971813109 (130h59m0.344392465s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:49:54.251260420 (130h59m0.623839765s) [upload=104740]: Done uploading segments... Jul 24 09:49:54.251276872 (130h59m0.623856227s) [upload=104740]: Upload finished. err: <nil> Jul 24 09:50:48.811147701 (130h59m55.183727056s) [upload=104752]: Starting upload Jul 24 09:50:48.811259444 (130h59m55.183838829s) [upload=104752]: Done starting upload Jul 24 09:50:48.811386498 (130h59m55.183965883s) [upload=104752]: Uploading segments... Jul 24 09:50:48.811437335 (130h59m55.18401669s) [upload=104752]: Got next segment. Inline: true Jul 24 09:50:48.811441182 (130h59m55.184020538s) [upload=104752]: Waiting for error group managing segments... Jul 24 09:50:48.811474957 (130h59m55.184054312s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:50:48.811479656 (130h59m55.184059011s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:50:48.811482131 (130h59m55.184061486s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:50:49.085645812 (130h59m55.458225167s) [upload=104752]: Done uploading segments... Jul 24 09:50:49.085664027 (130h59m55.458243382s) [upload=104752]: Upload finished. err: <nil> Jul 24 09:51:52.143001303 (131h0m58.515580658s) [upload=104767]: Starting upload Jul 24 09:51:52.143067560 (131h0m58.515646915s) [upload=104767]: Done starting upload Jul 24 09:51:52.143126222 (131h0m58.515705577s) [upload=104767]: Uploading segments... Jul 24 09:51:52.143163774 (131h0m58.515743129s) [upload=104767]: Got next segment. Inline: true Jul 24 09:51:52.143167592 (131h0m58.515746947s) [upload=104767]: Waiting for error group managing segments... Jul 24 09:51:52.143202719 (131h0m58.515782074s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:51:52.143207468 (131h0m58.515786813s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:51:52.143210043 (131h0m58.515789388s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:51:52.596288812 (131h0m58.968868157s) [upload=104767]: Done uploading segments... Jul 24 09:51:52.596306687 (131h0m58.968886032s) [upload=104767]: Upload finished. err: <nil> Jul 24 09:52:34.688885621 (131h1m41.061464966s) [upload=104775]: Starting upload Jul 24 09:52:34.688938663 (131h1m41.061518018s) [upload=104775]: Done starting upload Jul 24 09:52:34.688983298 (131h1m41.061562653s) [upload=104775]: Uploading segments... Jul 24 09:52:34.689010750 (131h1m41.061590105s) [upload=104775]: Got next segment. Inline: true Jul 24 09:52:34.689014378 (131h1m41.061593733s) [upload=104775]: Waiting for error group managing segments... Jul 24 09:52:34.689050106 (131h1m41.061629461s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:52:34.689054504 (131h1m41.061633849s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:52:34.689058522 (131h1m41.061637877s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:52:34.985853686 (131h1m41.358433031s) [upload=104775]: Done uploading segments... Jul 24 09:52:34.985874075 (131h1m41.35845343s) [upload=104775]: Upload finished. err: <nil> Jul 24 09:53:33.658681752 (131h2m40.031261107s) [upload=104789]: Starting upload Jul 24 09:53:33.658743130 (131h2m40.031322475s) [upload=104789]: Done starting upload Jul 24 09:53:33.658852189 (131h2m40.031431544s) [upload=104789]: Uploading segments... Jul 24 09:53:33.658886614 (131h2m40.031465969s) [upload=104789]: Got next segment. Inline: true Jul 24 09:53:33.658890441 (131h2m40.031469796s) [upload=104789]: Waiting for error group managing segments... Jul 24 09:53:33.658935548 (131h2m40.031514903s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:53:33.658940047 (131h2m40.031519402s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:53:33.658942892 (131h2m40.031522247s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:53:34.044724862 (131h2m40.417304227s) [upload=104789]: Done uploading segments... Jul 24 09:53:34.044748257 (131h2m40.417327612s) [upload=104789]: Upload finished. err: <nil>
Duration: 1.940306791s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000548175s
FAIL (2025-07-24 09:54:46 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 813s) [upload=104702]: Starting upload Jul 24 09:46:57.683505650 (130h56m4.056085005s) [upload=104702]: Done starting upload Jul 24 09:46:57.683557279 (130h56m4.056136634s) [upload=104702]: Uploading segments... Jul 24 09:46:57.683587847 (130h56m4.056167202s) [upload=104702]: Got next segment. Inline: true Jul 24 09:46:57.683591223 (130h56m4.056170578s) [upload=104702]: Waiting for error group managing segments... Jul 24 09:46:57.683627943 (130h56m4.056207298s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:46:57.683632302 (130h56m4.056211657s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:46:57.683635338 (130h56m4.056214693s) [upload=104702]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:46:58.027539489 (130h56m4.400118845s) [upload=104702]: Done uploading segments... Jul 24 09:46:58.027555950 (130h56m4.400135305s) [upload=104702]: Upload finished. err: <nil> Jul 24 09:47:14.659060250 (130h56m21.031639595s) [upload=104705]: Starting upload Jul 24 09:47:14.659136015 (130h56m21.03171536s) [upload=104705]: Done starting upload Jul 24 09:47:14.659198274 (130h56m21.031777629s) [upload=104705]: Uploading segments... Jul 24 09:47:14.659234294 (130h56m21.031813639s) [upload=104705]: Got next segment. Inline: true Jul 24 09:47:14.659238311 (130h56m21.031817656s) [upload=104705]: Waiting for error group managing segments... Jul 24 09:47:14.659268970 (130h56m21.031848325s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:14.659273729 (130h56m21.031853084s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:14.659276404 (130h56m21.031855749s) [upload=104705]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:14.972135203 (130h56m21.344714558s) [upload=104705]: Done uploading segments... Jul 24 09:47:14.972153989 (130h56m21.344733344s) [upload=104705]: Upload finished. err: <nil> Jul 24 09:47:51.417630323 (130h56m57.790209678s) [upload=104714]: Starting upload Jul 24 09:47:51.417696018 (130h56m57.790275373s) [upload=104714]: Done starting upload Jul 24 09:47:51.417758006 (130h56m57.790337361s) [upload=104714]: Uploading segments... Jul 24 09:47:51.417836797 (130h56m57.790416142s) [upload=104714]: Got next segment. Inline: true Jul 24 09:47:51.417841035 (130h56m57.79042039s) [upload=104714]: Waiting for error group managing segments... Jul 24 09:47:51.417877385 (130h56m57.790456741s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:47:51.417882114 (130h56m57.790461469s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:47:51.417884579 (130h56m57.790463934s) [upload=104714]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:47:51.693929209 (130h56m58.066508564s) [upload=104714]: Done uploading segments... Jul 24 09:47:51.693948486 (130h56m58.066527841s) [upload=104714]: Upload finished. err: <nil> Jul 24 09:48:30.339202112 (130h57m36.711781467s) [upload=104721]: Starting upload Jul 24 09:48:30.339261806 (130h57m36.711841161s) [upload=104721]: Done starting upload Jul 24 09:48:30.339324405 (130h57m36.711903761s) [upload=104721]: Uploading segments... Jul 24 09:48:30.339403888 (130h57m36.711983243s) [upload=104721]: Got next segment. Inline: true Jul 24 09:48:30.339408376 (130h57m36.711987732s) [upload=104721]: Waiting for error group managing segments... Jul 24 09:48:30.339448363 (130h57m36.712027718s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:30.339453262 (130h57m36.712032617s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:30.339455587 (130h57m36.712034942s) [upload=104721]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:30.640282044 (130h57m37.012861399s) [upload=104721]: Done uploading segments... Jul 24 09:48:30.640296521 (130h57m37.012875876s) [upload=104721]: Upload finished. err: <nil> Jul 24 09:48:46.345209259 (130h57m52.717788615s) [upload=104724]: Starting upload Jul 24 09:48:46.345259656 (130h57m52.717839011s) [upload=104724]: Done starting upload Jul 24 09:48:46.345303189 (130h57m52.717882544s) [upload=104724]: Uploading segments... Jul 24 09:48:46.345377631 (130h57m52.717956987s) [upload=104724]: Got next segment. Inline: true Jul 24 09:48:46.345381759 (130h57m52.717961114s) [upload=104724]: Waiting for error group managing segments... Jul 24 09:48:46.345430032 (130h57m52.718009377s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:48:46.345438027 (130h57m52.718017382s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:48:46.345440652 (130h57m52.718020007s) [upload=104724]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:48:46.625333176 (130h57m52.997912531s) [upload=104724]: Done uploading segments... Jul 24 09:48:46.625348975 (130h57m52.99792832s) [upload=104724]: Upload finished. err: <nil> Jul 24 09:49:53.971630320 (130h59m0.344209675s) [upload=104740]: Starting upload Jul 24 09:49:53.971686478 (130h59m0.344265833s) [upload=104740]: Done starting upload Jul 24 09:49:53.971735882 (130h59m0.344315237s) [upload=104740]: Uploading segments... Jul 24 09:49:53.971768785 (130h59m0.34434814s) [upload=104740]: Got next segment. Inline: true Jul 24 09:49:53.971772703 (130h59m0.344352058s) [upload=104740]: Waiting for error group managing segments... Jul 24 09:49:53.971805325 (130h59m0.34438468s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:49:53.971810485 (130h59m0.34438984s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:49:53.971813109 (130h59m0.344392465s) [upload=104740]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:49:54.251260420 (130h59m0.623839765s) [upload=104740]: Done uploading segments... Jul 24 09:49:54.251276872 (130h59m0.623856227s) [upload=104740]: Upload finished. err: <nil> Jul 24 09:50:48.811147701 (130h59m55.183727056s) [upload=104752]: Starting upload Jul 24 09:50:48.811259444 (130h59m55.183838829s) [upload=104752]: Done starting upload Jul 24 09:50:48.811386498 (130h59m55.183965883s) [upload=104752]: Uploading segments... Jul 24 09:50:48.811437335 (130h59m55.18401669s) [upload=104752]: Got next segment. Inline: true Jul 24 09:50:48.811441182 (130h59m55.184020538s) [upload=104752]: Waiting for error group managing segments... Jul 24 09:50:48.811474957 (130h59m55.184054312s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:50:48.811479656 (130h59m55.184059011s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:50:48.811482131 (130h59m55.184061486s) [upload=104752]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:50:49.085645812 (130h59m55.458225167s) [upload=104752]: Done uploading segments... Jul 24 09:50:49.085664027 (130h59m55.458243382s) [upload=104752]: Upload finished. err: <nil> Jul 24 09:51:52.143001303 (131h0m58.515580658s) [upload=104767]: Starting upload Jul 24 09:51:52.143067560 (131h0m58.515646915s) [upload=104767]: Done starting upload Jul 24 09:51:52.143126222 (131h0m58.515705577s) [upload=104767]: Uploading segments... Jul 24 09:51:52.143163774 (131h0m58.515743129s) [upload=104767]: Got next segment. Inline: true Jul 24 09:51:52.143167592 (131h0m58.515746947s) [upload=104767]: Waiting for error group managing segments... Jul 24 09:51:52.143202719 (131h0m58.515782074s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:51:52.143207468 (131h0m58.515786813s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:51:52.143210043 (131h0m58.515789388s) [upload=104767]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:51:52.596288812 (131h0m58.968868157s) [upload=104767]: Done uploading segments... Jul 24 09:51:52.596306687 (131h0m58.968886032s) [upload=104767]: Upload finished. err: <nil> Jul 24 09:52:34.688885621 (131h1m41.061464966s) [upload=104775]: Starting upload Jul 24 09:52:34.688938663 (131h1m41.061518018s) [upload=104775]: Done starting upload Jul 24 09:52:34.688983298 (131h1m41.061562653s) [upload=104775]: Uploading segments... Jul 24 09:52:34.689010750 (131h1m41.061590105s) [upload=104775]: Got next segment. Inline: true Jul 24 09:52:34.689014378 (131h1m41.061593733s) [upload=104775]: Waiting for error group managing segments... Jul 24 09:52:34.689050106 (131h1m41.061629461s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:52:34.689054504 (131h1m41.061633849s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:52:34.689058522 (131h1m41.061637877s) [upload=104775]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:52:34.985853686 (131h1m41.358433031s) [upload=104775]: Done uploading segments... Jul 24 09:52:34.985874075 (131h1m41.35845343s) [upload=104775]: Upload finished. err: <nil> Jul 24 09:53:33.658681752 (131h2m40.031261107s) [upload=104789]: Starting upload Jul 24 09:53:33.658743130 (131h2m40.031322475s) [upload=104789]: Done starting upload Jul 24 09:53:33.658852189 (131h2m40.031431544s) [upload=104789]: Uploading segments... Jul 24 09:53:33.658886614 (131h2m40.031465969s) [upload=104789]: Got next segment. Inline: true Jul 24 09:53:33.658890441 (131h2m40.031469796s) [upload=104789]: Waiting for error group managing segments... Jul 24 09:53:33.658935548 (131h2m40.031514903s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 24 09:53:33.658940047 (131h2m40.031519402s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 24 09:53:33.658942892 (131h2m40.031522247s) [upload=104789]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 24 09:53:34.044724862 (131h2m40.417304227s) [upload=104789]: Done uploading segments... Jul 24 09:53:34.044748257 (131h2m40.417327612s) [upload=104789]: Upload finished. err: <nil>
Duration: 30.00057679s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
12.24013ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:25:23 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 12.263965ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
28.240263ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:24:11 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 28.268267ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................] duration:
16.475976ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:23:51 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 16.499008ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................] duration:
17.803295ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:23:25 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 17.828361ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................] duration:
9.699328ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:22:14 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 9.721201ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
3 out of 60 is failed (threshold=3) [X...XX......................................................] duration:
10.623356ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:21:55 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 10.647063ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
3 out of 60 is failed (threshold=3) [.X...XX.....................................................] duration:
13.210437ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:21:16 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 13.232708ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
4 out of 60 is failed (threshold=3) [X.X...XX....................................................] duration:
44.662404ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:20:55 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 44.683965ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
5 out of 60 is failed (threshold=3) [XX.X...XX...................................................] duration:
22.802439ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:20:05 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 22.824302ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
5 out of 60 is failed (threshold=3) [.XX.X...XX..................................................] duration:
22.501994ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:19:00 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 22.525318ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
5 out of 60 is failed (threshold=3) [..XX.X...XX.................................................] duration:
15.93051ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:18:12 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 15.958034ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [X..XX.X...XX................................................] duration:
26.495555ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:17:02 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 26.521083ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [.X..XX.X...XX...............................................] duration:
14.148843ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:16:27 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 14.175664ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [..X..XX.X...XX..............................................] duration:
22.586045ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:15:23 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 22.624218ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [...X..XX.X...XX.............................................] duration:
22.759146ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:14:52 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 22.78221ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [....X..XX.X...XX............................................] duration:
13.899083ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:13:46 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 13.923681ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [.....X..XX.X...XX...........................................] duration:
19.856783ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:12:48 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 19.881981ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [......X..XX.X...XX..........................................] duration:
13.338962ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:12:09 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 13.363809ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [.......X..XX.X...XX.........................................] duration:
18.979977ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:11:16 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 19.009203ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [........X..XX.X...XX........................................] duration:
16.477178ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:10:12 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 16.496846ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [.........X..XX.X...XX.......................................] duration:
16.00367ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:09:13 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 16.028719ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [..........X..XX.X...XX......................................] duration:
27.691295ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:08:29 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 27.71948ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [...........X..XX.X...XX.....................................] duration:
17.359717ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:08:02 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 17.404862ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [............X..XX.X...XX....................................] duration:
14.531534ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:06:53 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 14.548408ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [.............X..XX.X...XX...................................] duration:
16.160721ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:05:55 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 16.187494ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [..............X..XX.X...XX..................................] duration:
27.041943ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:04:59 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 27.068824ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [...............X..XX.X...XX.................................] duration:
22.855472ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:04:01 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 22.902042ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [................X..XX.X...XX................................] duration:
16.153709ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:02:58 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 16.173887ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [.................X..XX.X...XX...............................] duration:
24.227146ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:01:59 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 24.254288ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [..................X..XX.X...XX..............................] duration:
16.643987ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:01:28 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 16.670137ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [...................X..XX.X...XX.............................] duration:
22.112972ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:00:57 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 22.150443ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [....................X..XX.X...XX............................] duration:
16.990559ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 08:00:07 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 17.01128ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [.....................X..XX.X...XX...........................] duration:
13.25903ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 07:59:15 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 13.27969ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [......................X..XX.X...XX..........................] duration:
12.733224ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 07:58:56 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 12.753262ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [.......................X..XX.X...XX.........................] duration:
29.737881ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 07:58:31 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 29.760144ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [........................X..XX.X...XX........................] duration:
14.270807ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 07:58:05 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 14.296365ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [.........................X..XX.X...XX.......................] duration:
17.898387ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 07:57:02 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 17.925349ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [..........................X..XX.X...XX......................] duration:
13.594692ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 07:56:24 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 13.622235ms
core
website
|
checkers.HTTP{"GET" "https://www.apple.com/robots.txt"} failure (antiblip window 3/60): (http.apple_robots_txt)antiblip:
6 out of 60 is failed (threshold=3) [...........................X..XX.X...XX.....................] duration:
19.077574ms remote:
"tcp:[2600:1417:3f:aa8::1aca]:443" target:
https://www.apple.com/robots.txt
FAIL (2025-07-24 07:55:52 UTC)
orbiter warning: Get "https://www.apple.com/robots.txt": remote error: tls: internal error
Duration: 19.10128ms
core
website
|