Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
1.909182606s
FAIL (2025-07-23 17:41:37 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.909213526s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
1.935348151s
FAIL (2025-07-23 17:40:53 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.935373429s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
1.836577031s
FAIL (2025-07-23 17:39:39 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.836602781s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.89618508s
FAIL (2025-07-23 17:39:11 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.896213343s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.108921409s
FAIL (2025-07-23 17:38:23 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 2.108949604s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.101172424s
FAIL (2025-07-23 17:37:18 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 2.101199935s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.935659326s
FAIL (2025-07-23 17:36:14 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.935683902s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.899788144s
FAIL (2025-07-23 17:35:36 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.899812109s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.948198265s
FAIL (2025-07-23 17:34:55 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.948225248s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.907966892s
FAIL (2025-07-23 17:34:08 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.907988433s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.139889881s
FAIL (2025-07-23 17:33:08 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 2.139917454s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.940033126s
FAIL (2025-07-23 17:32:15 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.940057183s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.906129247s
FAIL (2025-07-23 17:31:01 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.906153324s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.88208506s
FAIL (2025-07-23 17:30:36 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.882109017s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.909085314s
FAIL (2025-07-23 17:30:19 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.909113376s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.906188171s
FAIL (2025-07-23 17:29:31 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.906212457s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.898355501s
FAIL (2025-07-23 17:28:41 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.898377934s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.854564003s
FAIL (2025-07-23 17:27:31 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.854601345s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.893696307s
FAIL (2025-07-23 17:26:17 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.893722376s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.892569241s
FAIL (2025-07-23 17:25:32 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.892598117s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.946829109s
FAIL (2025-07-23 17:24:31 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.946857133s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.061113291s
FAIL (2025-07-23 17:23:28 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 2.06113965s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
174.040324ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:23:13 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 174.068078ms
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.908191073s
FAIL (2025-07-23 17:23:09 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.908222142s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.930111782s
FAIL (2025-07-23 17:22:36 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.930138384s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
2 out of 60 is failed (threshold=6) [XX..........................................................] duration:
172.043693ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:22:29 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 172.061567ms
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.899459032s
FAIL (2025-07-23 17:21:47 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.899487367s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [XXX.........................................................] duration:
176.71469ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:21:47 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 176.737033ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [.XXX........................................................] duration:
170.355534ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:21:20 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 170.380131ms
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.918885344s
FAIL (2025-07-23 17:20:47 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.918920611s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.912128905s
FAIL (2025-07-23 17:20:25 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.912159795s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [..XXX.......................................................] duration:
175.680923ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:20:19 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 175.711812ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [...XXX......................................................] duration:
176.695597ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:19:46 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 176.737347ms
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.891313789s
FAIL (2025-07-23 17:19:25 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.891348624s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [....XXX.....................................................] duration:
175.717563ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:19:20 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 175.74214ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [.....XXX....................................................] duration:
175.836982ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:18:59 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 175.863963ms
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.163611639s
FAIL (2025-07-23 17:18:23 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 2.163640733s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [......XXX...................................................] duration:
177.673535ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:17:48 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 177.692212ms
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.911046516s
FAIL (2025-07-23 17:17:25 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.911072165s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [.......XXX..................................................] duration:
175.160851ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:16:58 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 175.19757ms
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.886459149s
FAIL (2025-07-23 17:16:47 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.886477956s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.92944154s
FAIL (2025-07-23 17:16:12 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.929469805s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [........XXX.................................................] duration:
170.800035ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:16:07 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 170.81872ms
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.914851867s
FAIL (2025-07-23 17:15:27 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.91487384s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [.........XXX................................................] duration:
191.871192ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:15:13 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 191.904446ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [..........XXX...............................................] duration:
194.364772ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:14:43 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 194.39027ms
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.964534183s
FAIL (2025-07-23 17:14:24 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.964554221s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [...........XXX..............................................] duration:
176.74022ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:14:03 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 176.763063ms
edge
linksharing
bgp
eu1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.928571415s
FAIL (2025-07-23 17:13:42 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 56]: Upload finished. err: <nil> Jul 23 17:01:53.784406490 (114h11m0.156985845s) [upload=91261]: Starting upload Jul 23 17:01:53.784486924 (114h11m0.157066279s) [upload=91261]: Done starting upload Jul 23 17:01:53.784562879 (114h11m0.157142244s) [upload=91261]: Uploading segments... Jul 23 17:01:53.784603718 (114h11m0.157183083s) [upload=91261]: Got next segment. Inline: true Jul 23 17:01:53.784608447 (114h11m0.157187802s) [upload=91261]: Waiting for error group managing segments... Jul 23 17:01:53.784646810 (114h11m0.157226165s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:01:53.784652100 (114h11m0.157231465s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:01:53.784655446 (114h11m0.157234801s) [upload=91261]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:01:54.055426172 (114h11m0.428005527s) [upload=91261]: Done uploading segments... Jul 23 17:01:54.055451501 (114h11m0.428030856s) [upload=91261]: Upload finished. err: <nil> Jul 23 17:02:19.724954145 (114h11m26.09753355s) [upload=91266]: Starting upload Jul 23 17:02:19.725082140 (114h11m26.097661505s) [upload=91266]: Done starting upload Jul 23 17:02:19.725161422 (114h11m26.097740787s) [upload=91266]: Uploading segments... Jul 23 17:02:19.725214233 (114h11m26.097793638s) [upload=91266]: Got next segment. Inline: true Jul 23 17:02:19.725221256 (114h11m26.097800631s) [upload=91266]: Waiting for error group managing segments... Jul 23 17:02:19.725266242 (114h11m26.097845597s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:19.725272674 (114h11m26.09785203s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:19.725276792 (114h11m26.097856187s) [upload=91266]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:20.018795503 (114h11m26.391374878s) [upload=91266]: Done uploading segments... Jul 23 17:02:20.018817534 (114h11m26.391396919s) [upload=91266]: Upload finished. err: <nil> Jul 23 17:02:43.103530288 (114h11m49.476109643s) [upload=91273]: Starting upload Jul 23 17:02:43.103600633 (114h11m49.476179988s) [upload=91273]: Done starting upload Jul 23 17:02:43.103651541 (114h11m49.476230896s) [upload=91273]: Uploading segments... Jul 23 17:02:43.103688431 (114h11m49.476267786s) [upload=91273]: Got next segment. Inline: true Jul 23 17:02:43.103692008 (114h11m49.476271353s) [upload=91273]: Waiting for error group managing segments... Jul 23 17:02:43.103723037 (114h11m49.476302392s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:02:43.103727236 (114h11m49.476306591s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:02:43.103729640 (114h11m49.476308995s) [upload=91273]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:02:43.437291648 (114h11m49.809871053s) [upload=91273]: Done uploading segments... Jul 23 17:02:43.437316295 (114h11m49.80989567s) [upload=91273]: Upload finished. err: <nil> Jul 23 17:03:24.786718871 (114h12m31.159298226s) [upload=91280]: Starting upload Jul 23 17:03:24.786781090 (114h12m31.159360445s) [upload=91280]: Done starting upload Jul 23 17:03:24.786853659 (114h12m31.159433014s) [upload=91280]: Uploading segments... Jul 23 17:03:24.786977736 (114h12m31.159557091s) [upload=91280]: Got next segment. Inline: true Jul 23 17:03:24.786982946 (114h12m31.159562301s) [upload=91280]: Waiting for error group managing segments... Jul 23 17:03:24.787026940 (114h12m31.159606295s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:24.787032360 (114h12m31.159611715s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:24.787037110 (114h12m31.159616465s) [upload=91280]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:25.073047945 (114h12m31.44562729s) [upload=91280]: Done uploading segments... Jul 23 17:03:25.073066500 (114h12m31.445645855s) [upload=91280]: Upload finished. err: <nil> Jul 23 17:03:53.468709763 (114h12m59.841289118s) [upload=91287]: Starting upload Jul 23 17:03:53.468781481 (114h12m59.841360836s) [upload=91287]: Done starting upload Jul 23 17:03:53.468842487 (114h12m59.841421842s) [upload=91287]: Uploading segments... Jul 23 17:03:53.468882403 (114h12m59.841461768s) [upload=91287]: Got next segment. Inline: true Jul 23 17:03:53.468887914 (114h12m59.841467259s) [upload=91287]: Waiting for error group managing segments... Jul 23 17:03:53.468934503 (114h12m59.841513858s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:03:53.468940694 (114h12m59.841520049s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:03:53.468944012 (114h12m59.841523357s) [upload=91287]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:03:53.747443305 (114h13m0.12002268s) [upload=91287]: Done uploading segments... Jul 23 17:03:53.747469775 (114h13m0.12004914s) [upload=91287]: Upload finished. err: <nil> Jul 23 17:05:03.313210226 (114h14m9.685789591s) [upload=91302]: Starting upload Jul 23 17:05:03.313298756 (114h14m9.685878111s) [upload=91302]: Done starting upload Jul 23 17:05:03.313373128 (114h14m9.685952483s) [upload=91302]: Uploading segments... Jul 23 17:05:03.313418805 (114h14m9.68599816s) [upload=91302]: Got next segment. Inline: true Jul 23 17:05:03.313424606 (114h14m9.686003961s) [upload=91302]: Waiting for error group managing segments... Jul 23 17:05:03.313470504 (114h14m9.68604988s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:03.313538694 (114h14m9.68611805s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:03.313544285 (114h14m9.68612365s) [upload=91302]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:03.628644591 (114h14m10.001223946s) [upload=91302]: Done uploading segments... Jul 23 17:05:03.628668406 (114h14m10.001247761s) [upload=91302]: Upload finished. err: <nil> Jul 23 17:05:26.717561034 (114h14m33.090140389s) [upload=91310]: Starting upload Jul 23 17:05:26.717619706 (114h14m33.090199061s) [upload=91310]: Done starting upload Jul 23 17:05:26.717688738 (114h14m33.090268093s) [upload=91310]: Uploading segments... Jul 23 17:05:26.717748703 (114h14m33.090328058s) [upload=91310]: Got next segment. Inline: true Jul 23 17:05:26.717752540 (114h14m33.090331895s) [upload=91310]: Waiting for error group managing segments... Jul 23 17:05:26.717827663 (114h14m33.090407018s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:05:26.717833034 (114h14m33.090412389s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:05:26.717835599 (114h14m33.090414954s) [upload=91310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:05:26.994914154 (114h14m33.367493509s) [upload=91310]: Done uploading segments... Jul 23 17:05:26.994932748 (114h14m33.367512104s) [upload=91310]: Upload finished. err: <nil> Jul 23 17:06:40.807086916 (114h15m47.179666272s) [upload=91325]: Starting upload Jul 23 17:06:40.807144617 (114h15m47.179723972s) [upload=91325]: Done starting upload Jul 23 17:06:40.807240991 (114h15m47.179820346s) [upload=91325]: Uploading segments... Jul 23 17:06:40.807336354 (114h15m47.179915699s) [upload=91325]: Got next segment. Inline: true Jul 23 17:06:40.807341333 (114h15m47.179920688s) [upload=91325]: Waiting for error group managing segments... Jul 23 17:06:40.807383203 (114h15m47.179962558s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:06:40.807388764 (114h15m47.179968119s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:06:40.807391349 (114h15m47.179970704s) [upload=91325]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:06:41.071900373 (114h15m47.444479728s) [upload=91325]: Done uploading segments... Jul 23 17:06:41.071917245 (114h15m47.4444966s) [upload=91325]: Upload finished. err: <nil> Jul 23 17:07:20.458442152 (114h16m26.831021507s) [upload=91333]: Starting upload Jul 23 17:07:20.458500633 (114h16m26.831079988s) [upload=91333]: Done starting upload Jul 23 17:07:20.458550208 (114h16m26.831129564s) [upload=91333]: Uploading segments... Jul 23 17:07:20.458585987 (114h16m26.831165332s) [upload=91333]: Got next segment. Inline: true Jul 23 17:07:20.458590766 (114h16m26.831170121s) [upload=91333]: Waiting for error group managing segments... Jul 23 17:07:20.458623177 (114h16m26.831202532s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:07:20.458627757 (114h16m26.831207112s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:07:20.458630021 (114h16m26.831209366s) [upload=91333]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:07:20.733561587 (114h16m27.106140972s) [upload=91333]: Done uploading segments... Jul 23 17:07:20.733590151 (114h16m27.106169537s) [upload=91333]: Upload finished. err: <nil> Jul 23 17:08:26.811260725 (114h17m33.18384008s) [upload=91347]: Starting upload Jul 23 17:08:26.811315139 (114h17m33.183894484s) [upload=91347]: Done starting upload Jul 23 17:08:26.812026741 (114h17m33.184606086s) [upload=91347]: Uploading segments... Jul 23 17:08:26.812100723 (114h17m33.184680078s) [upload=91347]: Got next segment. Inline: true Jul 23 17:08:26.812105411 (114h17m33.184684767s) [upload=91347]: Waiting for error group managing segments... Jul 23 17:08:26.812137483 (114h17m33.184716838s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 23 17:08:26.812149777 (114h17m33.184729122s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 23 17:08:26.812152412 (114h17m33.184731767s) [upload=91347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 23 17:08:27.091249960 (114h17m33.463829315s) [upload=91347]: Done uploading segments... Jul 23 17:08:27.091280979 (114h17m33.463860334s) [upload=91347]: Upload finished. err: <nil>
Duration: 1.928598788s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
3 out of 60 is failed (threshold=6) [............XXX.............................................] duration:
173.76167ms remote:
"tcp:207.211.208.129:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt
FAIL (2025-07-23 17:13:24 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 173.791678ms
edge
linksharing
bgp
eu1
|