Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
6.793975058s
FAIL (2025-07-13 16:09:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.793993201s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.877167052s
FAIL (2025-07-13 16:09:01 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 13 15:54:46.108871399 (486h44m20.879512734s) [upload=389315]: Done starting upload Jul 13 15:54:46.108943557 (486h44m20.879584892s) [upload=389315]: Uploading segments... Jul 13 15:54:46.108977262 (486h44m20.879618597s) [upload=389315]: Got next segment. Inline: true Jul 13 15:54:46.108981219 (486h44m20.879622554s) [upload=389315]: Waiting for error group managing segments... Jul 13 15:54:46.109017639 (486h44m20.879658974s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:54:46.109022589 (486h44m20.879663924s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:54:46.109025304 (486h44m20.879666639s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:54:46.386239686 (486h44m21.156881031s) [upload=389315]: Done uploading segments... Jul 13 15:54:46.386269193 (486h44m21.156910528s) [upload=389315]: Upload finished. err: <nil> Jul 13 15:55:40.344470993 (486h45m15.115112328s) [upload=389328]: Starting upload Jul 13 15:55:40.344550375 (486h45m15.11519171s) [upload=389328]: Done starting upload Jul 13 15:55:40.344652100 (486h45m15.115293465s) [upload=389328]: Uploading segments... Jul 13 15:55:40.344712545 (486h45m15.11535392s) [upload=389328]: Got next segment. Inline: true Jul 13 15:55:40.344720150 (486h45m15.115361515s) [upload=389328]: Waiting for error group managing segments... Jul 13 15:55:40.344778762 (486h45m15.115420107s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:55:40.344787619 (486h45m15.115428954s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:55:40.344790805 (486h45m15.11543214s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:55:40.623795121 (486h45m15.394436456s) [upload=389328]: Done uploading segments... Jul 13 15:55:40.623836190 (486h45m15.394477525s) [upload=389328]: Upload finished. err: <nil> Jul 13 15:56:54.182246759 (486h46m28.952888094s) [upload=389343]: Starting upload Jul 13 15:56:54.182305641 (486h46m28.952946977s) [upload=389343]: Done starting upload Jul 13 15:56:54.182351328 (486h46m28.952992663s) [upload=389343]: Uploading segments... Jul 13 15:56:54.182381687 (486h46m28.953023012s) [upload=389343]: Got next segment. Inline: true Jul 13 15:56:54.182385254 (486h46m28.953026579s) [upload=389343]: Waiting for error group managing segments... Jul 13 15:56:54.182415882 (486h46m28.953057217s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:56:54.182420331 (486h46m28.953061666s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:56:54.182422585 (486h46m28.95306392s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:56:54.468829364 (486h46m29.239470699s) [upload=389343]: Done uploading segments... Jul 13 15:56:54.468847930 (486h46m29.239489265s) [upload=389343]: Upload finished. err: <nil> Jul 13 15:58:03.662420515 (486h47m38.43306185s) [upload=389361]: Starting upload Jul 13 15:58:03.662481121 (486h47m38.433122456s) [upload=389361]: Done starting upload Jul 13 15:58:03.662551736 (486h47m38.433193071s) [upload=389361]: Uploading segments... Jul 13 15:58:03.662647138 (486h47m38.433288473s) [upload=389361]: Got next segment. Inline: true Jul 13 15:58:03.662652058 (486h47m38.433293393s) [upload=389361]: Waiting for error group managing segments... Jul 13 15:58:03.662713356 (486h47m38.433354691s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:03.662718996 (486h47m38.433360331s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:03.662722012 (486h47m38.433363347s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:04.014783378 (486h47m38.785424713s) [upload=389361]: Done uploading segments... Jul 13 15:58:04.014799388 (486h47m38.785440723s) [upload=389361]: Upload finished. err: <nil> Jul 13 15:58:31.000045680 (486h48m5.770687015s) [upload=389368]: Starting upload Jul 13 15:58:31.000113600 (486h48m5.770754925s) [upload=389368]: Done starting upload Jul 13 15:58:31.000272984 (486h48m5.770914329s) [upload=389368]: Uploading segments... Jul 13 15:58:31.000434754 (486h48m5.771076109s) [upload=389368]: Got next segment. Inline: true Jul 13 15:58:31.000442729 (486h48m5.771084064s) [upload=389368]: Waiting for error group managing segments... Jul 13 15:58:31.000532702 (486h48m5.771174047s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:31.000542761 (486h48m5.771184096s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:31.000546748 (486h48m5.771188083s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:31.279315035 (486h48m6.04995641s) [upload=389368]: Done uploading segments... Jul 13 15:58:31.279338460 (486h48m6.049979815s) [upload=389368]: Upload finished. err: <nil> Jul 13 15:58:57.803093746 (486h48m32.573735071s) [upload=389373]: Starting upload Jul 13 15:58:57.803144844 (486h48m32.573786179s) [upload=389373]: Done starting upload Jul 13 15:58:57.803198046 (486h48m32.573839381s) [upload=389373]: Uploading segments... Jul 13 15:58:57.803227161 (486h48m32.573868496s) [upload=389373]: Got next segment. Inline: true Jul 13 15:58:57.803230578 (486h48m32.573871913s) [upload=389373]: Waiting for error group managing segments... Jul 13 15:58:57.803259313 (486h48m32.573900648s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:57.803263490 (486h48m32.573904825s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:57.803265885 (486h48m32.57390722s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:58.308341968 (486h48m33.078983293s) [upload=389373]: Done uploading segments... Jul 13 15:58:58.308359793 (486h48m33.079001118s) [upload=389373]: Upload finished. err: <nil> Jul 13 15:59:43.717160756 (486h49m18.487802081s) [upload=389385]: Starting upload Jul 13 15:59:43.717224758 (486h49m18.487866094s) [upload=389385]: Done starting upload Jul 13 15:59:43.717275816 (486h49m18.487917141s) [upload=389385]: Uploading segments... Jul 13 15:59:43.717306805 (486h49m18.48794813s) [upload=389385]: Got next segment. Inline: true Jul 13 15:59:43.717310563 (486h49m18.487951888s) [upload=389385]: Waiting for error group managing segments... Jul 13 15:59:43.717342414 (486h49m18.487983749s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:43.717347584 (486h49m18.487988909s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:43.717351421 (486h49m18.487992756s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:44.030128334 (486h49m18.800769669s) [upload=389385]: Done uploading segments... Jul 13 15:59:44.030150106 (486h49m18.800791441s) [upload=389385]: Upload finished. err: <nil> Jul 13 15:59:58.743009541 (486h49m33.513650876s) [upload=389390]: Starting upload Jul 13 15:59:58.743057132 (486h49m33.513698467s) [upload=389390]: Done starting upload Jul 13 15:59:58.743099995 (486h49m33.51374133s) [upload=389390]: Uploading segments... Jul 13 15:59:58.743128329 (486h49m33.513769654s) [upload=389390]: Got next segment. Inline: true Jul 13 15:59:58.743131555 (486h49m33.51377288s) [upload=389390]: Waiting for error group managing segments... Jul 13 15:59:58.743157975 (486h49m33.51379931s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:58.743162384 (486h49m33.513803719s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:58.743164628 (486h49m33.513805963s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:59.052447722 (486h49m33.823089057s) [upload=389390]: Done uploading segments... Jul 13 15:59:59.052459595 (486h49m33.82310092s) [upload=389390]: Upload finished. err: <nil> Jul 13 16:00:47.777149861 (486h50m22.547791186s) [upload=389402]: Starting upload Jul 13 16:00:47.777208903 (486h50m22.547850238s) [upload=389402]: Done starting upload Jul 13 16:00:47.777265191 (486h50m22.547906516s) [upload=389402]: Uploading segments... Jul 13 16:00:47.777297553 (486h50m22.547938888s) [upload=389402]: Got next segment. Inline: true Jul 13 16:00:47.777301380 (486h50m22.547942715s) [upload=389402]: Waiting for error group managing segments... Jul 13 16:00:47.777333241 (486h50m22.547974576s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:00:47.777339402 (486h50m22.547980737s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:00:47.777341748 (486h50m22.547983083s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:00:48.315202595 (486h50m23.08584393s) [upload=389402]: Done uploading segments... Jul 13 16:00:48.315221921 (486h50m23.085863246s) [upload=389402]: Upload finished. err: <nil> Jul 13 16:01:41.500642721 (486h51m16.271284056s) [upload=389416]: Starting upload Jul 13 16:01:41.500744706 (486h51m16.271386041s) [upload=389416]: Done starting upload Jul 13 16:01:41.500806174 (486h51m16.271447509s) [upload=389416]: Uploading segments... Jul 13 16:01:41.500837604 (486h51m16.271478939s) [upload=389416]: Got next segment. Inline: true Jul 13 16:01:41.500841311 (486h51m16.271482646s) [upload=389416]: Waiting for error group managing segments... Jul 13 16:01:41.500874174 (486h51m16.271515509s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:01:41.500878933 (486h51m16.271520258s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:01:41.500881377 (486h51m16.271522712s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:01:41.784662533 (486h51m16.555303868s) [upload=389416]: Done uploading segments... Jul 13 16:01:41.784680327 (486h51m16.555321652s) [upload=389416]: Upload finished. err: <nil>
Duration: 1.877200285s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.266164683s
FAIL (2025-07-13 16:08:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.266187808s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
6.55795327s
FAIL (2025-07-13 16:07:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.557975434s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.885901352s
FAIL (2025-07-13 16:07:50 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 13 15:54:46.108871399 (486h44m20.879512734s) [upload=389315]: Done starting upload Jul 13 15:54:46.108943557 (486h44m20.879584892s) [upload=389315]: Uploading segments... Jul 13 15:54:46.108977262 (486h44m20.879618597s) [upload=389315]: Got next segment. Inline: true Jul 13 15:54:46.108981219 (486h44m20.879622554s) [upload=389315]: Waiting for error group managing segments... Jul 13 15:54:46.109017639 (486h44m20.879658974s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:54:46.109022589 (486h44m20.879663924s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:54:46.109025304 (486h44m20.879666639s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:54:46.386239686 (486h44m21.156881031s) [upload=389315]: Done uploading segments... Jul 13 15:54:46.386269193 (486h44m21.156910528s) [upload=389315]: Upload finished. err: <nil> Jul 13 15:55:40.344470993 (486h45m15.115112328s) [upload=389328]: Starting upload Jul 13 15:55:40.344550375 (486h45m15.11519171s) [upload=389328]: Done starting upload Jul 13 15:55:40.344652100 (486h45m15.115293465s) [upload=389328]: Uploading segments... Jul 13 15:55:40.344712545 (486h45m15.11535392s) [upload=389328]: Got next segment. Inline: true Jul 13 15:55:40.344720150 (486h45m15.115361515s) [upload=389328]: Waiting for error group managing segments... Jul 13 15:55:40.344778762 (486h45m15.115420107s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:55:40.344787619 (486h45m15.115428954s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:55:40.344790805 (486h45m15.11543214s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:55:40.623795121 (486h45m15.394436456s) [upload=389328]: Done uploading segments... Jul 13 15:55:40.623836190 (486h45m15.394477525s) [upload=389328]: Upload finished. err: <nil> Jul 13 15:56:54.182246759 (486h46m28.952888094s) [upload=389343]: Starting upload Jul 13 15:56:54.182305641 (486h46m28.952946977s) [upload=389343]: Done starting upload Jul 13 15:56:54.182351328 (486h46m28.952992663s) [upload=389343]: Uploading segments... Jul 13 15:56:54.182381687 (486h46m28.953023012s) [upload=389343]: Got next segment. Inline: true Jul 13 15:56:54.182385254 (486h46m28.953026579s) [upload=389343]: Waiting for error group managing segments... Jul 13 15:56:54.182415882 (486h46m28.953057217s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:56:54.182420331 (486h46m28.953061666s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:56:54.182422585 (486h46m28.95306392s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:56:54.468829364 (486h46m29.239470699s) [upload=389343]: Done uploading segments... Jul 13 15:56:54.468847930 (486h46m29.239489265s) [upload=389343]: Upload finished. err: <nil> Jul 13 15:58:03.662420515 (486h47m38.43306185s) [upload=389361]: Starting upload Jul 13 15:58:03.662481121 (486h47m38.433122456s) [upload=389361]: Done starting upload Jul 13 15:58:03.662551736 (486h47m38.433193071s) [upload=389361]: Uploading segments... Jul 13 15:58:03.662647138 (486h47m38.433288473s) [upload=389361]: Got next segment. Inline: true Jul 13 15:58:03.662652058 (486h47m38.433293393s) [upload=389361]: Waiting for error group managing segments... Jul 13 15:58:03.662713356 (486h47m38.433354691s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:03.662718996 (486h47m38.433360331s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:03.662722012 (486h47m38.433363347s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:04.014783378 (486h47m38.785424713s) [upload=389361]: Done uploading segments... Jul 13 15:58:04.014799388 (486h47m38.785440723s) [upload=389361]: Upload finished. err: <nil> Jul 13 15:58:31.000045680 (486h48m5.770687015s) [upload=389368]: Starting upload Jul 13 15:58:31.000113600 (486h48m5.770754925s) [upload=389368]: Done starting upload Jul 13 15:58:31.000272984 (486h48m5.770914329s) [upload=389368]: Uploading segments... Jul 13 15:58:31.000434754 (486h48m5.771076109s) [upload=389368]: Got next segment. Inline: true Jul 13 15:58:31.000442729 (486h48m5.771084064s) [upload=389368]: Waiting for error group managing segments... Jul 13 15:58:31.000532702 (486h48m5.771174047s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:31.000542761 (486h48m5.771184096s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:31.000546748 (486h48m5.771188083s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:31.279315035 (486h48m6.04995641s) [upload=389368]: Done uploading segments... Jul 13 15:58:31.279338460 (486h48m6.049979815s) [upload=389368]: Upload finished. err: <nil> Jul 13 15:58:57.803093746 (486h48m32.573735071s) [upload=389373]: Starting upload Jul 13 15:58:57.803144844 (486h48m32.573786179s) [upload=389373]: Done starting upload Jul 13 15:58:57.803198046 (486h48m32.573839381s) [upload=389373]: Uploading segments... Jul 13 15:58:57.803227161 (486h48m32.573868496s) [upload=389373]: Got next segment. Inline: true Jul 13 15:58:57.803230578 (486h48m32.573871913s) [upload=389373]: Waiting for error group managing segments... Jul 13 15:58:57.803259313 (486h48m32.573900648s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:57.803263490 (486h48m32.573904825s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:57.803265885 (486h48m32.57390722s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:58.308341968 (486h48m33.078983293s) [upload=389373]: Done uploading segments... Jul 13 15:58:58.308359793 (486h48m33.079001118s) [upload=389373]: Upload finished. err: <nil> Jul 13 15:59:43.717160756 (486h49m18.487802081s) [upload=389385]: Starting upload Jul 13 15:59:43.717224758 (486h49m18.487866094s) [upload=389385]: Done starting upload Jul 13 15:59:43.717275816 (486h49m18.487917141s) [upload=389385]: Uploading segments... Jul 13 15:59:43.717306805 (486h49m18.48794813s) [upload=389385]: Got next segment. Inline: true Jul 13 15:59:43.717310563 (486h49m18.487951888s) [upload=389385]: Waiting for error group managing segments... Jul 13 15:59:43.717342414 (486h49m18.487983749s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:43.717347584 (486h49m18.487988909s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:43.717351421 (486h49m18.487992756s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:44.030128334 (486h49m18.800769669s) [upload=389385]: Done uploading segments... Jul 13 15:59:44.030150106 (486h49m18.800791441s) [upload=389385]: Upload finished. err: <nil> Jul 13 15:59:58.743009541 (486h49m33.513650876s) [upload=389390]: Starting upload Jul 13 15:59:58.743057132 (486h49m33.513698467s) [upload=389390]: Done starting upload Jul 13 15:59:58.743099995 (486h49m33.51374133s) [upload=389390]: Uploading segments... Jul 13 15:59:58.743128329 (486h49m33.513769654s) [upload=389390]: Got next segment. Inline: true Jul 13 15:59:58.743131555 (486h49m33.51377288s) [upload=389390]: Waiting for error group managing segments... Jul 13 15:59:58.743157975 (486h49m33.51379931s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:58.743162384 (486h49m33.513803719s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:58.743164628 (486h49m33.513805963s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:59.052447722 (486h49m33.823089057s) [upload=389390]: Done uploading segments... Jul 13 15:59:59.052459595 (486h49m33.82310092s) [upload=389390]: Upload finished. err: <nil> Jul 13 16:00:47.777149861 (486h50m22.547791186s) [upload=389402]: Starting upload Jul 13 16:00:47.777208903 (486h50m22.547850238s) [upload=389402]: Done starting upload Jul 13 16:00:47.777265191 (486h50m22.547906516s) [upload=389402]: Uploading segments... Jul 13 16:00:47.777297553 (486h50m22.547938888s) [upload=389402]: Got next segment. Inline: true Jul 13 16:00:47.777301380 (486h50m22.547942715s) [upload=389402]: Waiting for error group managing segments... Jul 13 16:00:47.777333241 (486h50m22.547974576s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:00:47.777339402 (486h50m22.547980737s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:00:47.777341748 (486h50m22.547983083s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:00:48.315202595 (486h50m23.08584393s) [upload=389402]: Done uploading segments... Jul 13 16:00:48.315221921 (486h50m23.085863246s) [upload=389402]: Upload finished. err: <nil> Jul 13 16:01:41.500642721 (486h51m16.271284056s) [upload=389416]: Starting upload Jul 13 16:01:41.500744706 (486h51m16.271386041s) [upload=389416]: Done starting upload Jul 13 16:01:41.500806174 (486h51m16.271447509s) [upload=389416]: Uploading segments... Jul 13 16:01:41.500837604 (486h51m16.271478939s) [upload=389416]: Got next segment. Inline: true Jul 13 16:01:41.500841311 (486h51m16.271482646s) [upload=389416]: Waiting for error group managing segments... Jul 13 16:01:41.500874174 (486h51m16.271515509s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:01:41.500878933 (486h51m16.271520258s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:01:41.500881377 (486h51m16.271522712s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:01:41.784662533 (486h51m16.555303868s) [upload=389416]: Done uploading segments... Jul 13 16:01:41.784680327 (486h51m16.555321652s) [upload=389416]: Upload finished. err: <nil>
Duration: 1.88592573s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.473558473s
FAIL (2025-07-13 16:07:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.473579573s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
6.57447549s
FAIL (2025-07-13 16:07:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.574494456s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.9050729s
FAIL (2025-07-13 16:06:58 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 13 15:54:46.108871399 (486h44m20.879512734s) [upload=389315]: Done starting upload Jul 13 15:54:46.108943557 (486h44m20.879584892s) [upload=389315]: Uploading segments... Jul 13 15:54:46.108977262 (486h44m20.879618597s) [upload=389315]: Got next segment. Inline: true Jul 13 15:54:46.108981219 (486h44m20.879622554s) [upload=389315]: Waiting for error group managing segments... Jul 13 15:54:46.109017639 (486h44m20.879658974s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:54:46.109022589 (486h44m20.879663924s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:54:46.109025304 (486h44m20.879666639s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:54:46.386239686 (486h44m21.156881031s) [upload=389315]: Done uploading segments... Jul 13 15:54:46.386269193 (486h44m21.156910528s) [upload=389315]: Upload finished. err: <nil> Jul 13 15:55:40.344470993 (486h45m15.115112328s) [upload=389328]: Starting upload Jul 13 15:55:40.344550375 (486h45m15.11519171s) [upload=389328]: Done starting upload Jul 13 15:55:40.344652100 (486h45m15.115293465s) [upload=389328]: Uploading segments... Jul 13 15:55:40.344712545 (486h45m15.11535392s) [upload=389328]: Got next segment. Inline: true Jul 13 15:55:40.344720150 (486h45m15.115361515s) [upload=389328]: Waiting for error group managing segments... Jul 13 15:55:40.344778762 (486h45m15.115420107s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:55:40.344787619 (486h45m15.115428954s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:55:40.344790805 (486h45m15.11543214s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:55:40.623795121 (486h45m15.394436456s) [upload=389328]: Done uploading segments... Jul 13 15:55:40.623836190 (486h45m15.394477525s) [upload=389328]: Upload finished. err: <nil> Jul 13 15:56:54.182246759 (486h46m28.952888094s) [upload=389343]: Starting upload Jul 13 15:56:54.182305641 (486h46m28.952946977s) [upload=389343]: Done starting upload Jul 13 15:56:54.182351328 (486h46m28.952992663s) [upload=389343]: Uploading segments... Jul 13 15:56:54.182381687 (486h46m28.953023012s) [upload=389343]: Got next segment. Inline: true Jul 13 15:56:54.182385254 (486h46m28.953026579s) [upload=389343]: Waiting for error group managing segments... Jul 13 15:56:54.182415882 (486h46m28.953057217s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:56:54.182420331 (486h46m28.953061666s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:56:54.182422585 (486h46m28.95306392s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:56:54.468829364 (486h46m29.239470699s) [upload=389343]: Done uploading segments... Jul 13 15:56:54.468847930 (486h46m29.239489265s) [upload=389343]: Upload finished. err: <nil> Jul 13 15:58:03.662420515 (486h47m38.43306185s) [upload=389361]: Starting upload Jul 13 15:58:03.662481121 (486h47m38.433122456s) [upload=389361]: Done starting upload Jul 13 15:58:03.662551736 (486h47m38.433193071s) [upload=389361]: Uploading segments... Jul 13 15:58:03.662647138 (486h47m38.433288473s) [upload=389361]: Got next segment. Inline: true Jul 13 15:58:03.662652058 (486h47m38.433293393s) [upload=389361]: Waiting for error group managing segments... Jul 13 15:58:03.662713356 (486h47m38.433354691s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:03.662718996 (486h47m38.433360331s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:03.662722012 (486h47m38.433363347s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:04.014783378 (486h47m38.785424713s) [upload=389361]: Done uploading segments... Jul 13 15:58:04.014799388 (486h47m38.785440723s) [upload=389361]: Upload finished. err: <nil> Jul 13 15:58:31.000045680 (486h48m5.770687015s) [upload=389368]: Starting upload Jul 13 15:58:31.000113600 (486h48m5.770754925s) [upload=389368]: Done starting upload Jul 13 15:58:31.000272984 (486h48m5.770914329s) [upload=389368]: Uploading segments... Jul 13 15:58:31.000434754 (486h48m5.771076109s) [upload=389368]: Got next segment. Inline: true Jul 13 15:58:31.000442729 (486h48m5.771084064s) [upload=389368]: Waiting for error group managing segments... Jul 13 15:58:31.000532702 (486h48m5.771174047s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:31.000542761 (486h48m5.771184096s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:31.000546748 (486h48m5.771188083s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:31.279315035 (486h48m6.04995641s) [upload=389368]: Done uploading segments... Jul 13 15:58:31.279338460 (486h48m6.049979815s) [upload=389368]: Upload finished. err: <nil> Jul 13 15:58:57.803093746 (486h48m32.573735071s) [upload=389373]: Starting upload Jul 13 15:58:57.803144844 (486h48m32.573786179s) [upload=389373]: Done starting upload Jul 13 15:58:57.803198046 (486h48m32.573839381s) [upload=389373]: Uploading segments... Jul 13 15:58:57.803227161 (486h48m32.573868496s) [upload=389373]: Got next segment. Inline: true Jul 13 15:58:57.803230578 (486h48m32.573871913s) [upload=389373]: Waiting for error group managing segments... Jul 13 15:58:57.803259313 (486h48m32.573900648s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:57.803263490 (486h48m32.573904825s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:57.803265885 (486h48m32.57390722s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:58.308341968 (486h48m33.078983293s) [upload=389373]: Done uploading segments... Jul 13 15:58:58.308359793 (486h48m33.079001118s) [upload=389373]: Upload finished. err: <nil> Jul 13 15:59:43.717160756 (486h49m18.487802081s) [upload=389385]: Starting upload Jul 13 15:59:43.717224758 (486h49m18.487866094s) [upload=389385]: Done starting upload Jul 13 15:59:43.717275816 (486h49m18.487917141s) [upload=389385]: Uploading segments... Jul 13 15:59:43.717306805 (486h49m18.48794813s) [upload=389385]: Got next segment. Inline: true Jul 13 15:59:43.717310563 (486h49m18.487951888s) [upload=389385]: Waiting for error group managing segments... Jul 13 15:59:43.717342414 (486h49m18.487983749s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:43.717347584 (486h49m18.487988909s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:43.717351421 (486h49m18.487992756s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:44.030128334 (486h49m18.800769669s) [upload=389385]: Done uploading segments... Jul 13 15:59:44.030150106 (486h49m18.800791441s) [upload=389385]: Upload finished. err: <nil> Jul 13 15:59:58.743009541 (486h49m33.513650876s) [upload=389390]: Starting upload Jul 13 15:59:58.743057132 (486h49m33.513698467s) [upload=389390]: Done starting upload Jul 13 15:59:58.743099995 (486h49m33.51374133s) [upload=389390]: Uploading segments... Jul 13 15:59:58.743128329 (486h49m33.513769654s) [upload=389390]: Got next segment. Inline: true Jul 13 15:59:58.743131555 (486h49m33.51377288s) [upload=389390]: Waiting for error group managing segments... Jul 13 15:59:58.743157975 (486h49m33.51379931s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:58.743162384 (486h49m33.513803719s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:58.743164628 (486h49m33.513805963s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:59.052447722 (486h49m33.823089057s) [upload=389390]: Done uploading segments... Jul 13 15:59:59.052459595 (486h49m33.82310092s) [upload=389390]: Upload finished. err: <nil> Jul 13 16:00:47.777149861 (486h50m22.547791186s) [upload=389402]: Starting upload Jul 13 16:00:47.777208903 (486h50m22.547850238s) [upload=389402]: Done starting upload Jul 13 16:00:47.777265191 (486h50m22.547906516s) [upload=389402]: Uploading segments... Jul 13 16:00:47.777297553 (486h50m22.547938888s) [upload=389402]: Got next segment. Inline: true Jul 13 16:00:47.777301380 (486h50m22.547942715s) [upload=389402]: Waiting for error group managing segments... Jul 13 16:00:47.777333241 (486h50m22.547974576s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:00:47.777339402 (486h50m22.547980737s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:00:47.777341748 (486h50m22.547983083s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:00:48.315202595 (486h50m23.08584393s) [upload=389402]: Done uploading segments... Jul 13 16:00:48.315221921 (486h50m23.085863246s) [upload=389402]: Upload finished. err: <nil> Jul 13 16:01:41.500642721 (486h51m16.271284056s) [upload=389416]: Starting upload Jul 13 16:01:41.500744706 (486h51m16.271386041s) [upload=389416]: Done starting upload Jul 13 16:01:41.500806174 (486h51m16.271447509s) [upload=389416]: Uploading segments... Jul 13 16:01:41.500837604 (486h51m16.271478939s) [upload=389416]: Got next segment. Inline: true Jul 13 16:01:41.500841311 (486h51m16.271482646s) [upload=389416]: Waiting for error group managing segments... Jul 13 16:01:41.500874174 (486h51m16.271515509s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:01:41.500878933 (486h51m16.271520258s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:01:41.500881377 (486h51m16.271522712s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:01:41.784662533 (486h51m16.555303868s) [upload=389416]: Done uploading segments... Jul 13 16:01:41.784680327 (486h51m16.555321652s) [upload=389416]: Upload finished. err: <nil>
Duration: 1.905102015s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.322357609s
FAIL (2025-07-13 16:06:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.322553042s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.903779748s
FAIL (2025-07-13 16:05:59 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 13 15:54:46.108871399 (486h44m20.879512734s) [upload=389315]: Done starting upload Jul 13 15:54:46.108943557 (486h44m20.879584892s) [upload=389315]: Uploading segments... Jul 13 15:54:46.108977262 (486h44m20.879618597s) [upload=389315]: Got next segment. Inline: true Jul 13 15:54:46.108981219 (486h44m20.879622554s) [upload=389315]: Waiting for error group managing segments... Jul 13 15:54:46.109017639 (486h44m20.879658974s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:54:46.109022589 (486h44m20.879663924s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:54:46.109025304 (486h44m20.879666639s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:54:46.386239686 (486h44m21.156881031s) [upload=389315]: Done uploading segments... Jul 13 15:54:46.386269193 (486h44m21.156910528s) [upload=389315]: Upload finished. err: <nil> Jul 13 15:55:40.344470993 (486h45m15.115112328s) [upload=389328]: Starting upload Jul 13 15:55:40.344550375 (486h45m15.11519171s) [upload=389328]: Done starting upload Jul 13 15:55:40.344652100 (486h45m15.115293465s) [upload=389328]: Uploading segments... Jul 13 15:55:40.344712545 (486h45m15.11535392s) [upload=389328]: Got next segment. Inline: true Jul 13 15:55:40.344720150 (486h45m15.115361515s) [upload=389328]: Waiting for error group managing segments... Jul 13 15:55:40.344778762 (486h45m15.115420107s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:55:40.344787619 (486h45m15.115428954s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:55:40.344790805 (486h45m15.11543214s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:55:40.623795121 (486h45m15.394436456s) [upload=389328]: Done uploading segments... Jul 13 15:55:40.623836190 (486h45m15.394477525s) [upload=389328]: Upload finished. err: <nil> Jul 13 15:56:54.182246759 (486h46m28.952888094s) [upload=389343]: Starting upload Jul 13 15:56:54.182305641 (486h46m28.952946977s) [upload=389343]: Done starting upload Jul 13 15:56:54.182351328 (486h46m28.952992663s) [upload=389343]: Uploading segments... Jul 13 15:56:54.182381687 (486h46m28.953023012s) [upload=389343]: Got next segment. Inline: true Jul 13 15:56:54.182385254 (486h46m28.953026579s) [upload=389343]: Waiting for error group managing segments... Jul 13 15:56:54.182415882 (486h46m28.953057217s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:56:54.182420331 (486h46m28.953061666s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:56:54.182422585 (486h46m28.95306392s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:56:54.468829364 (486h46m29.239470699s) [upload=389343]: Done uploading segments... Jul 13 15:56:54.468847930 (486h46m29.239489265s) [upload=389343]: Upload finished. err: <nil> Jul 13 15:58:03.662420515 (486h47m38.43306185s) [upload=389361]: Starting upload Jul 13 15:58:03.662481121 (486h47m38.433122456s) [upload=389361]: Done starting upload Jul 13 15:58:03.662551736 (486h47m38.433193071s) [upload=389361]: Uploading segments... Jul 13 15:58:03.662647138 (486h47m38.433288473s) [upload=389361]: Got next segment. Inline: true Jul 13 15:58:03.662652058 (486h47m38.433293393s) [upload=389361]: Waiting for error group managing segments... Jul 13 15:58:03.662713356 (486h47m38.433354691s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:03.662718996 (486h47m38.433360331s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:03.662722012 (486h47m38.433363347s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:04.014783378 (486h47m38.785424713s) [upload=389361]: Done uploading segments... Jul 13 15:58:04.014799388 (486h47m38.785440723s) [upload=389361]: Upload finished. err: <nil> Jul 13 15:58:31.000045680 (486h48m5.770687015s) [upload=389368]: Starting upload Jul 13 15:58:31.000113600 (486h48m5.770754925s) [upload=389368]: Done starting upload Jul 13 15:58:31.000272984 (486h48m5.770914329s) [upload=389368]: Uploading segments... Jul 13 15:58:31.000434754 (486h48m5.771076109s) [upload=389368]: Got next segment. Inline: true Jul 13 15:58:31.000442729 (486h48m5.771084064s) [upload=389368]: Waiting for error group managing segments... Jul 13 15:58:31.000532702 (486h48m5.771174047s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:31.000542761 (486h48m5.771184096s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:31.000546748 (486h48m5.771188083s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:31.279315035 (486h48m6.04995641s) [upload=389368]: Done uploading segments... Jul 13 15:58:31.279338460 (486h48m6.049979815s) [upload=389368]: Upload finished. err: <nil> Jul 13 15:58:57.803093746 (486h48m32.573735071s) [upload=389373]: Starting upload Jul 13 15:58:57.803144844 (486h48m32.573786179s) [upload=389373]: Done starting upload Jul 13 15:58:57.803198046 (486h48m32.573839381s) [upload=389373]: Uploading segments... Jul 13 15:58:57.803227161 (486h48m32.573868496s) [upload=389373]: Got next segment. Inline: true Jul 13 15:58:57.803230578 (486h48m32.573871913s) [upload=389373]: Waiting for error group managing segments... Jul 13 15:58:57.803259313 (486h48m32.573900648s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:57.803263490 (486h48m32.573904825s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:57.803265885 (486h48m32.57390722s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:58.308341968 (486h48m33.078983293s) [upload=389373]: Done uploading segments... Jul 13 15:58:58.308359793 (486h48m33.079001118s) [upload=389373]: Upload finished. err: <nil> Jul 13 15:59:43.717160756 (486h49m18.487802081s) [upload=389385]: Starting upload Jul 13 15:59:43.717224758 (486h49m18.487866094s) [upload=389385]: Done starting upload Jul 13 15:59:43.717275816 (486h49m18.487917141s) [upload=389385]: Uploading segments... Jul 13 15:59:43.717306805 (486h49m18.48794813s) [upload=389385]: Got next segment. Inline: true Jul 13 15:59:43.717310563 (486h49m18.487951888s) [upload=389385]: Waiting for error group managing segments... Jul 13 15:59:43.717342414 (486h49m18.487983749s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:43.717347584 (486h49m18.487988909s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:43.717351421 (486h49m18.487992756s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:44.030128334 (486h49m18.800769669s) [upload=389385]: Done uploading segments... Jul 13 15:59:44.030150106 (486h49m18.800791441s) [upload=389385]: Upload finished. err: <nil> Jul 13 15:59:58.743009541 (486h49m33.513650876s) [upload=389390]: Starting upload Jul 13 15:59:58.743057132 (486h49m33.513698467s) [upload=389390]: Done starting upload Jul 13 15:59:58.743099995 (486h49m33.51374133s) [upload=389390]: Uploading segments... Jul 13 15:59:58.743128329 (486h49m33.513769654s) [upload=389390]: Got next segment. Inline: true Jul 13 15:59:58.743131555 (486h49m33.51377288s) [upload=389390]: Waiting for error group managing segments... Jul 13 15:59:58.743157975 (486h49m33.51379931s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:58.743162384 (486h49m33.513803719s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:58.743164628 (486h49m33.513805963s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:59.052447722 (486h49m33.823089057s) [upload=389390]: Done uploading segments... Jul 13 15:59:59.052459595 (486h49m33.82310092s) [upload=389390]: Upload finished. err: <nil> Jul 13 16:00:47.777149861 (486h50m22.547791186s) [upload=389402]: Starting upload Jul 13 16:00:47.777208903 (486h50m22.547850238s) [upload=389402]: Done starting upload Jul 13 16:00:47.777265191 (486h50m22.547906516s) [upload=389402]: Uploading segments... Jul 13 16:00:47.777297553 (486h50m22.547938888s) [upload=389402]: Got next segment. Inline: true Jul 13 16:00:47.777301380 (486h50m22.547942715s) [upload=389402]: Waiting for error group managing segments... Jul 13 16:00:47.777333241 (486h50m22.547974576s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:00:47.777339402 (486h50m22.547980737s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:00:47.777341748 (486h50m22.547983083s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:00:48.315202595 (486h50m23.08584393s) [upload=389402]: Done uploading segments... Jul 13 16:00:48.315221921 (486h50m23.085863246s) [upload=389402]: Upload finished. err: <nil> Jul 13 16:01:41.500642721 (486h51m16.271284056s) [upload=389416]: Starting upload Jul 13 16:01:41.500744706 (486h51m16.271386041s) [upload=389416]: Done starting upload Jul 13 16:01:41.500806174 (486h51m16.271447509s) [upload=389416]: Uploading segments... Jul 13 16:01:41.500837604 (486h51m16.271478939s) [upload=389416]: Got next segment. Inline: true Jul 13 16:01:41.500841311 (486h51m16.271482646s) [upload=389416]: Waiting for error group managing segments... Jul 13 16:01:41.500874174 (486h51m16.271515509s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:01:41.500878933 (486h51m16.271520258s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:01:41.500881377 (486h51m16.271522712s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:01:41.784662533 (486h51m16.555303868s) [upload=389416]: Done uploading segments... Jul 13 16:01:41.784680327 (486h51m16.555321652s) [upload=389416]: Upload finished. err: <nil>
Duration: 1.90381227s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.564486208s
FAIL (2025-07-13 16:05:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.564519352s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.888177977s
FAIL (2025-07-13 16:05:36 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 13 15:54:46.108871399 (486h44m20.879512734s) [upload=389315]: Done starting upload Jul 13 15:54:46.108943557 (486h44m20.879584892s) [upload=389315]: Uploading segments... Jul 13 15:54:46.108977262 (486h44m20.879618597s) [upload=389315]: Got next segment. Inline: true Jul 13 15:54:46.108981219 (486h44m20.879622554s) [upload=389315]: Waiting for error group managing segments... Jul 13 15:54:46.109017639 (486h44m20.879658974s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:54:46.109022589 (486h44m20.879663924s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:54:46.109025304 (486h44m20.879666639s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:54:46.386239686 (486h44m21.156881031s) [upload=389315]: Done uploading segments... Jul 13 15:54:46.386269193 (486h44m21.156910528s) [upload=389315]: Upload finished. err: <nil> Jul 13 15:55:40.344470993 (486h45m15.115112328s) [upload=389328]: Starting upload Jul 13 15:55:40.344550375 (486h45m15.11519171s) [upload=389328]: Done starting upload Jul 13 15:55:40.344652100 (486h45m15.115293465s) [upload=389328]: Uploading segments... Jul 13 15:55:40.344712545 (486h45m15.11535392s) [upload=389328]: Got next segment. Inline: true Jul 13 15:55:40.344720150 (486h45m15.115361515s) [upload=389328]: Waiting for error group managing segments... Jul 13 15:55:40.344778762 (486h45m15.115420107s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:55:40.344787619 (486h45m15.115428954s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:55:40.344790805 (486h45m15.11543214s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:55:40.623795121 (486h45m15.394436456s) [upload=389328]: Done uploading segments... Jul 13 15:55:40.623836190 (486h45m15.394477525s) [upload=389328]: Upload finished. err: <nil> Jul 13 15:56:54.182246759 (486h46m28.952888094s) [upload=389343]: Starting upload Jul 13 15:56:54.182305641 (486h46m28.952946977s) [upload=389343]: Done starting upload Jul 13 15:56:54.182351328 (486h46m28.952992663s) [upload=389343]: Uploading segments... Jul 13 15:56:54.182381687 (486h46m28.953023012s) [upload=389343]: Got next segment. Inline: true Jul 13 15:56:54.182385254 (486h46m28.953026579s) [upload=389343]: Waiting for error group managing segments... Jul 13 15:56:54.182415882 (486h46m28.953057217s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:56:54.182420331 (486h46m28.953061666s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:56:54.182422585 (486h46m28.95306392s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:56:54.468829364 (486h46m29.239470699s) [upload=389343]: Done uploading segments... Jul 13 15:56:54.468847930 (486h46m29.239489265s) [upload=389343]: Upload finished. err: <nil> Jul 13 15:58:03.662420515 (486h47m38.43306185s) [upload=389361]: Starting upload Jul 13 15:58:03.662481121 (486h47m38.433122456s) [upload=389361]: Done starting upload Jul 13 15:58:03.662551736 (486h47m38.433193071s) [upload=389361]: Uploading segments... Jul 13 15:58:03.662647138 (486h47m38.433288473s) [upload=389361]: Got next segment. Inline: true Jul 13 15:58:03.662652058 (486h47m38.433293393s) [upload=389361]: Waiting for error group managing segments... Jul 13 15:58:03.662713356 (486h47m38.433354691s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:03.662718996 (486h47m38.433360331s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:03.662722012 (486h47m38.433363347s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:04.014783378 (486h47m38.785424713s) [upload=389361]: Done uploading segments... Jul 13 15:58:04.014799388 (486h47m38.785440723s) [upload=389361]: Upload finished. err: <nil> Jul 13 15:58:31.000045680 (486h48m5.770687015s) [upload=389368]: Starting upload Jul 13 15:58:31.000113600 (486h48m5.770754925s) [upload=389368]: Done starting upload Jul 13 15:58:31.000272984 (486h48m5.770914329s) [upload=389368]: Uploading segments... Jul 13 15:58:31.000434754 (486h48m5.771076109s) [upload=389368]: Got next segment. Inline: true Jul 13 15:58:31.000442729 (486h48m5.771084064s) [upload=389368]: Waiting for error group managing segments... Jul 13 15:58:31.000532702 (486h48m5.771174047s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:31.000542761 (486h48m5.771184096s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:31.000546748 (486h48m5.771188083s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:31.279315035 (486h48m6.04995641s) [upload=389368]: Done uploading segments... Jul 13 15:58:31.279338460 (486h48m6.049979815s) [upload=389368]: Upload finished. err: <nil> Jul 13 15:58:57.803093746 (486h48m32.573735071s) [upload=389373]: Starting upload Jul 13 15:58:57.803144844 (486h48m32.573786179s) [upload=389373]: Done starting upload Jul 13 15:58:57.803198046 (486h48m32.573839381s) [upload=389373]: Uploading segments... Jul 13 15:58:57.803227161 (486h48m32.573868496s) [upload=389373]: Got next segment. Inline: true Jul 13 15:58:57.803230578 (486h48m32.573871913s) [upload=389373]: Waiting for error group managing segments... Jul 13 15:58:57.803259313 (486h48m32.573900648s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:57.803263490 (486h48m32.573904825s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:57.803265885 (486h48m32.57390722s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:58.308341968 (486h48m33.078983293s) [upload=389373]: Done uploading segments... Jul 13 15:58:58.308359793 (486h48m33.079001118s) [upload=389373]: Upload finished. err: <nil> Jul 13 15:59:43.717160756 (486h49m18.487802081s) [upload=389385]: Starting upload Jul 13 15:59:43.717224758 (486h49m18.487866094s) [upload=389385]: Done starting upload Jul 13 15:59:43.717275816 (486h49m18.487917141s) [upload=389385]: Uploading segments... Jul 13 15:59:43.717306805 (486h49m18.48794813s) [upload=389385]: Got next segment. Inline: true Jul 13 15:59:43.717310563 (486h49m18.487951888s) [upload=389385]: Waiting for error group managing segments... Jul 13 15:59:43.717342414 (486h49m18.487983749s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:43.717347584 (486h49m18.487988909s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:43.717351421 (486h49m18.487992756s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:44.030128334 (486h49m18.800769669s) [upload=389385]: Done uploading segments... Jul 13 15:59:44.030150106 (486h49m18.800791441s) [upload=389385]: Upload finished. err: <nil> Jul 13 15:59:58.743009541 (486h49m33.513650876s) [upload=389390]: Starting upload Jul 13 15:59:58.743057132 (486h49m33.513698467s) [upload=389390]: Done starting upload Jul 13 15:59:58.743099995 (486h49m33.51374133s) [upload=389390]: Uploading segments... Jul 13 15:59:58.743128329 (486h49m33.513769654s) [upload=389390]: Got next segment. Inline: true Jul 13 15:59:58.743131555 (486h49m33.51377288s) [upload=389390]: Waiting for error group managing segments... Jul 13 15:59:58.743157975 (486h49m33.51379931s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:58.743162384 (486h49m33.513803719s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:58.743164628 (486h49m33.513805963s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:59.052447722 (486h49m33.823089057s) [upload=389390]: Done uploading segments... Jul 13 15:59:59.052459595 (486h49m33.82310092s) [upload=389390]: Upload finished. err: <nil> Jul 13 16:00:47.777149861 (486h50m22.547791186s) [upload=389402]: Starting upload Jul 13 16:00:47.777208903 (486h50m22.547850238s) [upload=389402]: Done starting upload Jul 13 16:00:47.777265191 (486h50m22.547906516s) [upload=389402]: Uploading segments... Jul 13 16:00:47.777297553 (486h50m22.547938888s) [upload=389402]: Got next segment. Inline: true Jul 13 16:00:47.777301380 (486h50m22.547942715s) [upload=389402]: Waiting for error group managing segments... Jul 13 16:00:47.777333241 (486h50m22.547974576s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:00:47.777339402 (486h50m22.547980737s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:00:47.777341748 (486h50m22.547983083s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:00:48.315202595 (486h50m23.08584393s) [upload=389402]: Done uploading segments... Jul 13 16:00:48.315221921 (486h50m23.085863246s) [upload=389402]: Upload finished. err: <nil> Jul 13 16:01:41.500642721 (486h51m16.271284056s) [upload=389416]: Starting upload Jul 13 16:01:41.500744706 (486h51m16.271386041s) [upload=389416]: Done starting upload Jul 13 16:01:41.500806174 (486h51m16.271447509s) [upload=389416]: Uploading segments... Jul 13 16:01:41.500837604 (486h51m16.271478939s) [upload=389416]: Got next segment. Inline: true Jul 13 16:01:41.500841311 (486h51m16.271482646s) [upload=389416]: Waiting for error group managing segments... Jul 13 16:01:41.500874174 (486h51m16.271515509s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:01:41.500878933 (486h51m16.271520258s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:01:41.500881377 (486h51m16.271522712s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:01:41.784662533 (486h51m16.555303868s) [upload=389416]: Done uploading segments... Jul 13 16:01:41.784680327 (486h51m16.555321652s) [upload=389416]: Upload finished. err: <nil>
Duration: 1.888206101s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.912240315s
FAIL (2025-07-13 16:05:09 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 13 15:54:46.108871399 (486h44m20.879512734s) [upload=389315]: Done starting upload Jul 13 15:54:46.108943557 (486h44m20.879584892s) [upload=389315]: Uploading segments... Jul 13 15:54:46.108977262 (486h44m20.879618597s) [upload=389315]: Got next segment. Inline: true Jul 13 15:54:46.108981219 (486h44m20.879622554s) [upload=389315]: Waiting for error group managing segments... Jul 13 15:54:46.109017639 (486h44m20.879658974s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:54:46.109022589 (486h44m20.879663924s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:54:46.109025304 (486h44m20.879666639s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:54:46.386239686 (486h44m21.156881031s) [upload=389315]: Done uploading segments... Jul 13 15:54:46.386269193 (486h44m21.156910528s) [upload=389315]: Upload finished. err: <nil> Jul 13 15:55:40.344470993 (486h45m15.115112328s) [upload=389328]: Starting upload Jul 13 15:55:40.344550375 (486h45m15.11519171s) [upload=389328]: Done starting upload Jul 13 15:55:40.344652100 (486h45m15.115293465s) [upload=389328]: Uploading segments... Jul 13 15:55:40.344712545 (486h45m15.11535392s) [upload=389328]: Got next segment. Inline: true Jul 13 15:55:40.344720150 (486h45m15.115361515s) [upload=389328]: Waiting for error group managing segments... Jul 13 15:55:40.344778762 (486h45m15.115420107s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:55:40.344787619 (486h45m15.115428954s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:55:40.344790805 (486h45m15.11543214s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:55:40.623795121 (486h45m15.394436456s) [upload=389328]: Done uploading segments... Jul 13 15:55:40.623836190 (486h45m15.394477525s) [upload=389328]: Upload finished. err: <nil> Jul 13 15:56:54.182246759 (486h46m28.952888094s) [upload=389343]: Starting upload Jul 13 15:56:54.182305641 (486h46m28.952946977s) [upload=389343]: Done starting upload Jul 13 15:56:54.182351328 (486h46m28.952992663s) [upload=389343]: Uploading segments... Jul 13 15:56:54.182381687 (486h46m28.953023012s) [upload=389343]: Got next segment. Inline: true Jul 13 15:56:54.182385254 (486h46m28.953026579s) [upload=389343]: Waiting for error group managing segments... Jul 13 15:56:54.182415882 (486h46m28.953057217s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:56:54.182420331 (486h46m28.953061666s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:56:54.182422585 (486h46m28.95306392s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:56:54.468829364 (486h46m29.239470699s) [upload=389343]: Done uploading segments... Jul 13 15:56:54.468847930 (486h46m29.239489265s) [upload=389343]: Upload finished. err: <nil> Jul 13 15:58:03.662420515 (486h47m38.43306185s) [upload=389361]: Starting upload Jul 13 15:58:03.662481121 (486h47m38.433122456s) [upload=389361]: Done starting upload Jul 13 15:58:03.662551736 (486h47m38.433193071s) [upload=389361]: Uploading segments... Jul 13 15:58:03.662647138 (486h47m38.433288473s) [upload=389361]: Got next segment. Inline: true Jul 13 15:58:03.662652058 (486h47m38.433293393s) [upload=389361]: Waiting for error group managing segments... Jul 13 15:58:03.662713356 (486h47m38.433354691s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:03.662718996 (486h47m38.433360331s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:03.662722012 (486h47m38.433363347s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:04.014783378 (486h47m38.785424713s) [upload=389361]: Done uploading segments... Jul 13 15:58:04.014799388 (486h47m38.785440723s) [upload=389361]: Upload finished. err: <nil> Jul 13 15:58:31.000045680 (486h48m5.770687015s) [upload=389368]: Starting upload Jul 13 15:58:31.000113600 (486h48m5.770754925s) [upload=389368]: Done starting upload Jul 13 15:58:31.000272984 (486h48m5.770914329s) [upload=389368]: Uploading segments... Jul 13 15:58:31.000434754 (486h48m5.771076109s) [upload=389368]: Got next segment. Inline: true Jul 13 15:58:31.000442729 (486h48m5.771084064s) [upload=389368]: Waiting for error group managing segments... Jul 13 15:58:31.000532702 (486h48m5.771174047s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:31.000542761 (486h48m5.771184096s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:31.000546748 (486h48m5.771188083s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:31.279315035 (486h48m6.04995641s) [upload=389368]: Done uploading segments... Jul 13 15:58:31.279338460 (486h48m6.049979815s) [upload=389368]: Upload finished. err: <nil> Jul 13 15:58:57.803093746 (486h48m32.573735071s) [upload=389373]: Starting upload Jul 13 15:58:57.803144844 (486h48m32.573786179s) [upload=389373]: Done starting upload Jul 13 15:58:57.803198046 (486h48m32.573839381s) [upload=389373]: Uploading segments... Jul 13 15:58:57.803227161 (486h48m32.573868496s) [upload=389373]: Got next segment. Inline: true Jul 13 15:58:57.803230578 (486h48m32.573871913s) [upload=389373]: Waiting for error group managing segments... Jul 13 15:58:57.803259313 (486h48m32.573900648s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:57.803263490 (486h48m32.573904825s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:57.803265885 (486h48m32.57390722s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:58.308341968 (486h48m33.078983293s) [upload=389373]: Done uploading segments... Jul 13 15:58:58.308359793 (486h48m33.079001118s) [upload=389373]: Upload finished. err: <nil> Jul 13 15:59:43.717160756 (486h49m18.487802081s) [upload=389385]: Starting upload Jul 13 15:59:43.717224758 (486h49m18.487866094s) [upload=389385]: Done starting upload Jul 13 15:59:43.717275816 (486h49m18.487917141s) [upload=389385]: Uploading segments... Jul 13 15:59:43.717306805 (486h49m18.48794813s) [upload=389385]: Got next segment. Inline: true Jul 13 15:59:43.717310563 (486h49m18.487951888s) [upload=389385]: Waiting for error group managing segments... Jul 13 15:59:43.717342414 (486h49m18.487983749s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:43.717347584 (486h49m18.487988909s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:43.717351421 (486h49m18.487992756s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:44.030128334 (486h49m18.800769669s) [upload=389385]: Done uploading segments... Jul 13 15:59:44.030150106 (486h49m18.800791441s) [upload=389385]: Upload finished. err: <nil> Jul 13 15:59:58.743009541 (486h49m33.513650876s) [upload=389390]: Starting upload Jul 13 15:59:58.743057132 (486h49m33.513698467s) [upload=389390]: Done starting upload Jul 13 15:59:58.743099995 (486h49m33.51374133s) [upload=389390]: Uploading segments... Jul 13 15:59:58.743128329 (486h49m33.513769654s) [upload=389390]: Got next segment. Inline: true Jul 13 15:59:58.743131555 (486h49m33.51377288s) [upload=389390]: Waiting for error group managing segments... Jul 13 15:59:58.743157975 (486h49m33.51379931s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:58.743162384 (486h49m33.513803719s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:58.743164628 (486h49m33.513805963s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:59.052447722 (486h49m33.823089057s) [upload=389390]: Done uploading segments... Jul 13 15:59:59.052459595 (486h49m33.82310092s) [upload=389390]: Upload finished. err: <nil> Jul 13 16:00:47.777149861 (486h50m22.547791186s) [upload=389402]: Starting upload Jul 13 16:00:47.777208903 (486h50m22.547850238s) [upload=389402]: Done starting upload Jul 13 16:00:47.777265191 (486h50m22.547906516s) [upload=389402]: Uploading segments... Jul 13 16:00:47.777297553 (486h50m22.547938888s) [upload=389402]: Got next segment. Inline: true Jul 13 16:00:47.777301380 (486h50m22.547942715s) [upload=389402]: Waiting for error group managing segments... Jul 13 16:00:47.777333241 (486h50m22.547974576s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:00:47.777339402 (486h50m22.547980737s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:00:47.777341748 (486h50m22.547983083s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:00:48.315202595 (486h50m23.08584393s) [upload=389402]: Done uploading segments... Jul 13 16:00:48.315221921 (486h50m23.085863246s) [upload=389402]: Upload finished. err: <nil> Jul 13 16:01:41.500642721 (486h51m16.271284056s) [upload=389416]: Starting upload Jul 13 16:01:41.500744706 (486h51m16.271386041s) [upload=389416]: Done starting upload Jul 13 16:01:41.500806174 (486h51m16.271447509s) [upload=389416]: Uploading segments... Jul 13 16:01:41.500837604 (486h51m16.271478939s) [upload=389416]: Got next segment. Inline: true Jul 13 16:01:41.500841311 (486h51m16.271482646s) [upload=389416]: Waiting for error group managing segments... Jul 13 16:01:41.500874174 (486h51m16.271515509s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:01:41.500878933 (486h51m16.271520258s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:01:41.500881377 (486h51m16.271522712s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:01:41.784662533 (486h51m16.555303868s) [upload=389416]: Done uploading segments... Jul 13 16:01:41.784680327 (486h51m16.555321652s) [upload=389416]: Upload finished. err: <nil>
Duration: 1.912271253s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
6.273455631s
FAIL (2025-07-13 16:04:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.273481351s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.957523204s
FAIL (2025-07-13 16:04:32 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 13 15:54:46.108871399 (486h44m20.879512734s) [upload=389315]: Done starting upload Jul 13 15:54:46.108943557 (486h44m20.879584892s) [upload=389315]: Uploading segments... Jul 13 15:54:46.108977262 (486h44m20.879618597s) [upload=389315]: Got next segment. Inline: true Jul 13 15:54:46.108981219 (486h44m20.879622554s) [upload=389315]: Waiting for error group managing segments... Jul 13 15:54:46.109017639 (486h44m20.879658974s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:54:46.109022589 (486h44m20.879663924s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:54:46.109025304 (486h44m20.879666639s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:54:46.386239686 (486h44m21.156881031s) [upload=389315]: Done uploading segments... Jul 13 15:54:46.386269193 (486h44m21.156910528s) [upload=389315]: Upload finished. err: <nil> Jul 13 15:55:40.344470993 (486h45m15.115112328s) [upload=389328]: Starting upload Jul 13 15:55:40.344550375 (486h45m15.11519171s) [upload=389328]: Done starting upload Jul 13 15:55:40.344652100 (486h45m15.115293465s) [upload=389328]: Uploading segments... Jul 13 15:55:40.344712545 (486h45m15.11535392s) [upload=389328]: Got next segment. Inline: true Jul 13 15:55:40.344720150 (486h45m15.115361515s) [upload=389328]: Waiting for error group managing segments... Jul 13 15:55:40.344778762 (486h45m15.115420107s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:55:40.344787619 (486h45m15.115428954s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:55:40.344790805 (486h45m15.11543214s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:55:40.623795121 (486h45m15.394436456s) [upload=389328]: Done uploading segments... Jul 13 15:55:40.623836190 (486h45m15.394477525s) [upload=389328]: Upload finished. err: <nil> Jul 13 15:56:54.182246759 (486h46m28.952888094s) [upload=389343]: Starting upload Jul 13 15:56:54.182305641 (486h46m28.952946977s) [upload=389343]: Done starting upload Jul 13 15:56:54.182351328 (486h46m28.952992663s) [upload=389343]: Uploading segments... Jul 13 15:56:54.182381687 (486h46m28.953023012s) [upload=389343]: Got next segment. Inline: true Jul 13 15:56:54.182385254 (486h46m28.953026579s) [upload=389343]: Waiting for error group managing segments... Jul 13 15:56:54.182415882 (486h46m28.953057217s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:56:54.182420331 (486h46m28.953061666s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:56:54.182422585 (486h46m28.95306392s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:56:54.468829364 (486h46m29.239470699s) [upload=389343]: Done uploading segments... Jul 13 15:56:54.468847930 (486h46m29.239489265s) [upload=389343]: Upload finished. err: <nil> Jul 13 15:58:03.662420515 (486h47m38.43306185s) [upload=389361]: Starting upload Jul 13 15:58:03.662481121 (486h47m38.433122456s) [upload=389361]: Done starting upload Jul 13 15:58:03.662551736 (486h47m38.433193071s) [upload=389361]: Uploading segments... Jul 13 15:58:03.662647138 (486h47m38.433288473s) [upload=389361]: Got next segment. Inline: true Jul 13 15:58:03.662652058 (486h47m38.433293393s) [upload=389361]: Waiting for error group managing segments... Jul 13 15:58:03.662713356 (486h47m38.433354691s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:03.662718996 (486h47m38.433360331s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:03.662722012 (486h47m38.433363347s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:04.014783378 (486h47m38.785424713s) [upload=389361]: Done uploading segments... Jul 13 15:58:04.014799388 (486h47m38.785440723s) [upload=389361]: Upload finished. err: <nil> Jul 13 15:58:31.000045680 (486h48m5.770687015s) [upload=389368]: Starting upload Jul 13 15:58:31.000113600 (486h48m5.770754925s) [upload=389368]: Done starting upload Jul 13 15:58:31.000272984 (486h48m5.770914329s) [upload=389368]: Uploading segments... Jul 13 15:58:31.000434754 (486h48m5.771076109s) [upload=389368]: Got next segment. Inline: true Jul 13 15:58:31.000442729 (486h48m5.771084064s) [upload=389368]: Waiting for error group managing segments... Jul 13 15:58:31.000532702 (486h48m5.771174047s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:31.000542761 (486h48m5.771184096s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:31.000546748 (486h48m5.771188083s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:31.279315035 (486h48m6.04995641s) [upload=389368]: Done uploading segments... Jul 13 15:58:31.279338460 (486h48m6.049979815s) [upload=389368]: Upload finished. err: <nil> Jul 13 15:58:57.803093746 (486h48m32.573735071s) [upload=389373]: Starting upload Jul 13 15:58:57.803144844 (486h48m32.573786179s) [upload=389373]: Done starting upload Jul 13 15:58:57.803198046 (486h48m32.573839381s) [upload=389373]: Uploading segments... Jul 13 15:58:57.803227161 (486h48m32.573868496s) [upload=389373]: Got next segment. Inline: true Jul 13 15:58:57.803230578 (486h48m32.573871913s) [upload=389373]: Waiting for error group managing segments... Jul 13 15:58:57.803259313 (486h48m32.573900648s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:57.803263490 (486h48m32.573904825s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:57.803265885 (486h48m32.57390722s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:58.308341968 (486h48m33.078983293s) [upload=389373]: Done uploading segments... Jul 13 15:58:58.308359793 (486h48m33.079001118s) [upload=389373]: Upload finished. err: <nil> Jul 13 15:59:43.717160756 (486h49m18.487802081s) [upload=389385]: Starting upload Jul 13 15:59:43.717224758 (486h49m18.487866094s) [upload=389385]: Done starting upload Jul 13 15:59:43.717275816 (486h49m18.487917141s) [upload=389385]: Uploading segments... Jul 13 15:59:43.717306805 (486h49m18.48794813s) [upload=389385]: Got next segment. Inline: true Jul 13 15:59:43.717310563 (486h49m18.487951888s) [upload=389385]: Waiting for error group managing segments... Jul 13 15:59:43.717342414 (486h49m18.487983749s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:43.717347584 (486h49m18.487988909s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:43.717351421 (486h49m18.487992756s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:44.030128334 (486h49m18.800769669s) [upload=389385]: Done uploading segments... Jul 13 15:59:44.030150106 (486h49m18.800791441s) [upload=389385]: Upload finished. err: <nil> Jul 13 15:59:58.743009541 (486h49m33.513650876s) [upload=389390]: Starting upload Jul 13 15:59:58.743057132 (486h49m33.513698467s) [upload=389390]: Done starting upload Jul 13 15:59:58.743099995 (486h49m33.51374133s) [upload=389390]: Uploading segments... Jul 13 15:59:58.743128329 (486h49m33.513769654s) [upload=389390]: Got next segment. Inline: true Jul 13 15:59:58.743131555 (486h49m33.51377288s) [upload=389390]: Waiting for error group managing segments... Jul 13 15:59:58.743157975 (486h49m33.51379931s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:58.743162384 (486h49m33.513803719s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:58.743164628 (486h49m33.513805963s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:59.052447722 (486h49m33.823089057s) [upload=389390]: Done uploading segments... Jul 13 15:59:59.052459595 (486h49m33.82310092s) [upload=389390]: Upload finished. err: <nil> Jul 13 16:00:47.777149861 (486h50m22.547791186s) [upload=389402]: Starting upload Jul 13 16:00:47.777208903 (486h50m22.547850238s) [upload=389402]: Done starting upload Jul 13 16:00:47.777265191 (486h50m22.547906516s) [upload=389402]: Uploading segments... Jul 13 16:00:47.777297553 (486h50m22.547938888s) [upload=389402]: Got next segment. Inline: true Jul 13 16:00:47.777301380 (486h50m22.547942715s) [upload=389402]: Waiting for error group managing segments... Jul 13 16:00:47.777333241 (486h50m22.547974576s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:00:47.777339402 (486h50m22.547980737s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:00:47.777341748 (486h50m22.547983083s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:00:48.315202595 (486h50m23.08584393s) [upload=389402]: Done uploading segments... Jul 13 16:00:48.315221921 (486h50m23.085863246s) [upload=389402]: Upload finished. err: <nil> Jul 13 16:01:41.500642721 (486h51m16.271284056s) [upload=389416]: Starting upload Jul 13 16:01:41.500744706 (486h51m16.271386041s) [upload=389416]: Done starting upload Jul 13 16:01:41.500806174 (486h51m16.271447509s) [upload=389416]: Uploading segments... Jul 13 16:01:41.500837604 (486h51m16.271478939s) [upload=389416]: Got next segment. Inline: true Jul 13 16:01:41.500841311 (486h51m16.271482646s) [upload=389416]: Waiting for error group managing segments... Jul 13 16:01:41.500874174 (486h51m16.271515509s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:01:41.500878933 (486h51m16.271520258s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:01:41.500881377 (486h51m16.271522712s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:01:41.784662533 (486h51m16.555303868s) [upload=389416]: Done uploading segments... Jul 13 16:01:41.784680327 (486h51m16.555321652s) [upload=389416]: Upload finished. err: <nil>
Duration: 1.957550997s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.551032853s
FAIL (2025-07-13 16:04:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.551074444s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
6.482345872s
FAIL (2025-07-13 16:04:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.48237077s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.514710294s
FAIL (2025-07-13 16:03:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.514731585s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.863827863s
FAIL (2025-07-13 16:03:22 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 13 15:54:46.108871399 (486h44m20.879512734s) [upload=389315]: Done starting upload Jul 13 15:54:46.108943557 (486h44m20.879584892s) [upload=389315]: Uploading segments... Jul 13 15:54:46.108977262 (486h44m20.879618597s) [upload=389315]: Got next segment. Inline: true Jul 13 15:54:46.108981219 (486h44m20.879622554s) [upload=389315]: Waiting for error group managing segments... Jul 13 15:54:46.109017639 (486h44m20.879658974s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:54:46.109022589 (486h44m20.879663924s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:54:46.109025304 (486h44m20.879666639s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:54:46.386239686 (486h44m21.156881031s) [upload=389315]: Done uploading segments... Jul 13 15:54:46.386269193 (486h44m21.156910528s) [upload=389315]: Upload finished. err: <nil> Jul 13 15:55:40.344470993 (486h45m15.115112328s) [upload=389328]: Starting upload Jul 13 15:55:40.344550375 (486h45m15.11519171s) [upload=389328]: Done starting upload Jul 13 15:55:40.344652100 (486h45m15.115293465s) [upload=389328]: Uploading segments... Jul 13 15:55:40.344712545 (486h45m15.11535392s) [upload=389328]: Got next segment. Inline: true Jul 13 15:55:40.344720150 (486h45m15.115361515s) [upload=389328]: Waiting for error group managing segments... Jul 13 15:55:40.344778762 (486h45m15.115420107s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:55:40.344787619 (486h45m15.115428954s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:55:40.344790805 (486h45m15.11543214s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:55:40.623795121 (486h45m15.394436456s) [upload=389328]: Done uploading segments... Jul 13 15:55:40.623836190 (486h45m15.394477525s) [upload=389328]: Upload finished. err: <nil> Jul 13 15:56:54.182246759 (486h46m28.952888094s) [upload=389343]: Starting upload Jul 13 15:56:54.182305641 (486h46m28.952946977s) [upload=389343]: Done starting upload Jul 13 15:56:54.182351328 (486h46m28.952992663s) [upload=389343]: Uploading segments... Jul 13 15:56:54.182381687 (486h46m28.953023012s) [upload=389343]: Got next segment. Inline: true Jul 13 15:56:54.182385254 (486h46m28.953026579s) [upload=389343]: Waiting for error group managing segments... Jul 13 15:56:54.182415882 (486h46m28.953057217s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:56:54.182420331 (486h46m28.953061666s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:56:54.182422585 (486h46m28.95306392s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:56:54.468829364 (486h46m29.239470699s) [upload=389343]: Done uploading segments... Jul 13 15:56:54.468847930 (486h46m29.239489265s) [upload=389343]: Upload finished. err: <nil> Jul 13 15:58:03.662420515 (486h47m38.43306185s) [upload=389361]: Starting upload Jul 13 15:58:03.662481121 (486h47m38.433122456s) [upload=389361]: Done starting upload Jul 13 15:58:03.662551736 (486h47m38.433193071s) [upload=389361]: Uploading segments... Jul 13 15:58:03.662647138 (486h47m38.433288473s) [upload=389361]: Got next segment. Inline: true Jul 13 15:58:03.662652058 (486h47m38.433293393s) [upload=389361]: Waiting for error group managing segments... Jul 13 15:58:03.662713356 (486h47m38.433354691s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:03.662718996 (486h47m38.433360331s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:03.662722012 (486h47m38.433363347s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:04.014783378 (486h47m38.785424713s) [upload=389361]: Done uploading segments... Jul 13 15:58:04.014799388 (486h47m38.785440723s) [upload=389361]: Upload finished. err: <nil> Jul 13 15:58:31.000045680 (486h48m5.770687015s) [upload=389368]: Starting upload Jul 13 15:58:31.000113600 (486h48m5.770754925s) [upload=389368]: Done starting upload Jul 13 15:58:31.000272984 (486h48m5.770914329s) [upload=389368]: Uploading segments... Jul 13 15:58:31.000434754 (486h48m5.771076109s) [upload=389368]: Got next segment. Inline: true Jul 13 15:58:31.000442729 (486h48m5.771084064s) [upload=389368]: Waiting for error group managing segments... Jul 13 15:58:31.000532702 (486h48m5.771174047s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:31.000542761 (486h48m5.771184096s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:31.000546748 (486h48m5.771188083s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:31.279315035 (486h48m6.04995641s) [upload=389368]: Done uploading segments... Jul 13 15:58:31.279338460 (486h48m6.049979815s) [upload=389368]: Upload finished. err: <nil> Jul 13 15:58:57.803093746 (486h48m32.573735071s) [upload=389373]: Starting upload Jul 13 15:58:57.803144844 (486h48m32.573786179s) [upload=389373]: Done starting upload Jul 13 15:58:57.803198046 (486h48m32.573839381s) [upload=389373]: Uploading segments... Jul 13 15:58:57.803227161 (486h48m32.573868496s) [upload=389373]: Got next segment. Inline: true Jul 13 15:58:57.803230578 (486h48m32.573871913s) [upload=389373]: Waiting for error group managing segments... Jul 13 15:58:57.803259313 (486h48m32.573900648s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:57.803263490 (486h48m32.573904825s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:57.803265885 (486h48m32.57390722s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:58.308341968 (486h48m33.078983293s) [upload=389373]: Done uploading segments... Jul 13 15:58:58.308359793 (486h48m33.079001118s) [upload=389373]: Upload finished. err: <nil> Jul 13 15:59:43.717160756 (486h49m18.487802081s) [upload=389385]: Starting upload Jul 13 15:59:43.717224758 (486h49m18.487866094s) [upload=389385]: Done starting upload Jul 13 15:59:43.717275816 (486h49m18.487917141s) [upload=389385]: Uploading segments... Jul 13 15:59:43.717306805 (486h49m18.48794813s) [upload=389385]: Got next segment. Inline: true Jul 13 15:59:43.717310563 (486h49m18.487951888s) [upload=389385]: Waiting for error group managing segments... Jul 13 15:59:43.717342414 (486h49m18.487983749s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:43.717347584 (486h49m18.487988909s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:43.717351421 (486h49m18.487992756s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:44.030128334 (486h49m18.800769669s) [upload=389385]: Done uploading segments... Jul 13 15:59:44.030150106 (486h49m18.800791441s) [upload=389385]: Upload finished. err: <nil> Jul 13 15:59:58.743009541 (486h49m33.513650876s) [upload=389390]: Starting upload Jul 13 15:59:58.743057132 (486h49m33.513698467s) [upload=389390]: Done starting upload Jul 13 15:59:58.743099995 (486h49m33.51374133s) [upload=389390]: Uploading segments... Jul 13 15:59:58.743128329 (486h49m33.513769654s) [upload=389390]: Got next segment. Inline: true Jul 13 15:59:58.743131555 (486h49m33.51377288s) [upload=389390]: Waiting for error group managing segments... Jul 13 15:59:58.743157975 (486h49m33.51379931s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:58.743162384 (486h49m33.513803719s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:58.743164628 (486h49m33.513805963s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:59.052447722 (486h49m33.823089057s) [upload=389390]: Done uploading segments... Jul 13 15:59:59.052459595 (486h49m33.82310092s) [upload=389390]: Upload finished. err: <nil> Jul 13 16:00:47.777149861 (486h50m22.547791186s) [upload=389402]: Starting upload Jul 13 16:00:47.777208903 (486h50m22.547850238s) [upload=389402]: Done starting upload Jul 13 16:00:47.777265191 (486h50m22.547906516s) [upload=389402]: Uploading segments... Jul 13 16:00:47.777297553 (486h50m22.547938888s) [upload=389402]: Got next segment. Inline: true Jul 13 16:00:47.777301380 (486h50m22.547942715s) [upload=389402]: Waiting for error group managing segments... Jul 13 16:00:47.777333241 (486h50m22.547974576s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:00:47.777339402 (486h50m22.547980737s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:00:47.777341748 (486h50m22.547983083s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:00:48.315202595 (486h50m23.08584393s) [upload=389402]: Done uploading segments... Jul 13 16:00:48.315221921 (486h50m23.085863246s) [upload=389402]: Upload finished. err: <nil> Jul 13 16:01:41.500642721 (486h51m16.271284056s) [upload=389416]: Starting upload Jul 13 16:01:41.500744706 (486h51m16.271386041s) [upload=389416]: Done starting upload Jul 13 16:01:41.500806174 (486h51m16.271447509s) [upload=389416]: Uploading segments... Jul 13 16:01:41.500837604 (486h51m16.271478939s) [upload=389416]: Got next segment. Inline: true Jul 13 16:01:41.500841311 (486h51m16.271482646s) [upload=389416]: Waiting for error group managing segments... Jul 13 16:01:41.500874174 (486h51m16.271515509s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:01:41.500878933 (486h51m16.271520258s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:01:41.500881377 (486h51m16.271522712s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:01:41.784662533 (486h51m16.555303868s) [upload=389416]: Done uploading segments... Jul 13 16:01:41.784680327 (486h51m16.555321652s) [upload=389416]: Upload finished. err: <nil>
Duration: 1.863845366s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001072406s
FAIL (2025-07-13 16:03:20 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== load Jul 13 15:54:46.108871399 (486h44m20.879512734s) [upload=389315]: Done starting upload Jul 13 15:54:46.108943557 (486h44m20.879584892s) [upload=389315]: Uploading segments... Jul 13 15:54:46.108977262 (486h44m20.879618597s) [upload=389315]: Got next segment. Inline: true Jul 13 15:54:46.108981219 (486h44m20.879622554s) [upload=389315]: Waiting for error group managing segments... Jul 13 15:54:46.109017639 (486h44m20.879658974s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:54:46.109022589 (486h44m20.879663924s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:54:46.109025304 (486h44m20.879666639s) [upload=389315]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:54:46.386239686 (486h44m21.156881031s) [upload=389315]: Done uploading segments... Jul 13 15:54:46.386269193 (486h44m21.156910528s) [upload=389315]: Upload finished. err: <nil> Jul 13 15:55:40.344470993 (486h45m15.115112328s) [upload=389328]: Starting upload Jul 13 15:55:40.344550375 (486h45m15.11519171s) [upload=389328]: Done starting upload Jul 13 15:55:40.344652100 (486h45m15.115293465s) [upload=389328]: Uploading segments... Jul 13 15:55:40.344712545 (486h45m15.11535392s) [upload=389328]: Got next segment. Inline: true Jul 13 15:55:40.344720150 (486h45m15.115361515s) [upload=389328]: Waiting for error group managing segments... Jul 13 15:55:40.344778762 (486h45m15.115420107s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:55:40.344787619 (486h45m15.115428954s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:55:40.344790805 (486h45m15.11543214s) [upload=389328]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:55:40.623795121 (486h45m15.394436456s) [upload=389328]: Done uploading segments... Jul 13 15:55:40.623836190 (486h45m15.394477525s) [upload=389328]: Upload finished. err: <nil> Jul 13 15:56:54.182246759 (486h46m28.952888094s) [upload=389343]: Starting upload Jul 13 15:56:54.182305641 (486h46m28.952946977s) [upload=389343]: Done starting upload Jul 13 15:56:54.182351328 (486h46m28.952992663s) [upload=389343]: Uploading segments... Jul 13 15:56:54.182381687 (486h46m28.953023012s) [upload=389343]: Got next segment. Inline: true Jul 13 15:56:54.182385254 (486h46m28.953026579s) [upload=389343]: Waiting for error group managing segments... Jul 13 15:56:54.182415882 (486h46m28.953057217s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:56:54.182420331 (486h46m28.953061666s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:56:54.182422585 (486h46m28.95306392s) [upload=389343]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:56:54.468829364 (486h46m29.239470699s) [upload=389343]: Done uploading segments... Jul 13 15:56:54.468847930 (486h46m29.239489265s) [upload=389343]: Upload finished. err: <nil> Jul 13 15:58:03.662420515 (486h47m38.43306185s) [upload=389361]: Starting upload Jul 13 15:58:03.662481121 (486h47m38.433122456s) [upload=389361]: Done starting upload Jul 13 15:58:03.662551736 (486h47m38.433193071s) [upload=389361]: Uploading segments... Jul 13 15:58:03.662647138 (486h47m38.433288473s) [upload=389361]: Got next segment. Inline: true Jul 13 15:58:03.662652058 (486h47m38.433293393s) [upload=389361]: Waiting for error group managing segments... Jul 13 15:58:03.662713356 (486h47m38.433354691s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:03.662718996 (486h47m38.433360331s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:03.662722012 (486h47m38.433363347s) [upload=389361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:04.014783378 (486h47m38.785424713s) [upload=389361]: Done uploading segments... Jul 13 15:58:04.014799388 (486h47m38.785440723s) [upload=389361]: Upload finished. err: <nil> Jul 13 15:58:31.000045680 (486h48m5.770687015s) [upload=389368]: Starting upload Jul 13 15:58:31.000113600 (486h48m5.770754925s) [upload=389368]: Done starting upload Jul 13 15:58:31.000272984 (486h48m5.770914329s) [upload=389368]: Uploading segments... Jul 13 15:58:31.000434754 (486h48m5.771076109s) [upload=389368]: Got next segment. Inline: true Jul 13 15:58:31.000442729 (486h48m5.771084064s) [upload=389368]: Waiting for error group managing segments... Jul 13 15:58:31.000532702 (486h48m5.771174047s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:31.000542761 (486h48m5.771184096s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:31.000546748 (486h48m5.771188083s) [upload=389368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:31.279315035 (486h48m6.04995641s) [upload=389368]: Done uploading segments... Jul 13 15:58:31.279338460 (486h48m6.049979815s) [upload=389368]: Upload finished. err: <nil> Jul 13 15:58:57.803093746 (486h48m32.573735071s) [upload=389373]: Starting upload Jul 13 15:58:57.803144844 (486h48m32.573786179s) [upload=389373]: Done starting upload Jul 13 15:58:57.803198046 (486h48m32.573839381s) [upload=389373]: Uploading segments... Jul 13 15:58:57.803227161 (486h48m32.573868496s) [upload=389373]: Got next segment. Inline: true Jul 13 15:58:57.803230578 (486h48m32.573871913s) [upload=389373]: Waiting for error group managing segments... Jul 13 15:58:57.803259313 (486h48m32.573900648s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:58:57.803263490 (486h48m32.573904825s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:58:57.803265885 (486h48m32.57390722s) [upload=389373]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:58:58.308341968 (486h48m33.078983293s) [upload=389373]: Done uploading segments... Jul 13 15:58:58.308359793 (486h48m33.079001118s) [upload=389373]: Upload finished. err: <nil> Jul 13 15:59:43.717160756 (486h49m18.487802081s) [upload=389385]: Starting upload Jul 13 15:59:43.717224758 (486h49m18.487866094s) [upload=389385]: Done starting upload Jul 13 15:59:43.717275816 (486h49m18.487917141s) [upload=389385]: Uploading segments... Jul 13 15:59:43.717306805 (486h49m18.48794813s) [upload=389385]: Got next segment. Inline: true Jul 13 15:59:43.717310563 (486h49m18.487951888s) [upload=389385]: Waiting for error group managing segments... Jul 13 15:59:43.717342414 (486h49m18.487983749s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:43.717347584 (486h49m18.487988909s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:43.717351421 (486h49m18.487992756s) [upload=389385]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:44.030128334 (486h49m18.800769669s) [upload=389385]: Done uploading segments... Jul 13 15:59:44.030150106 (486h49m18.800791441s) [upload=389385]: Upload finished. err: <nil> Jul 13 15:59:58.743009541 (486h49m33.513650876s) [upload=389390]: Starting upload Jul 13 15:59:58.743057132 (486h49m33.513698467s) [upload=389390]: Done starting upload Jul 13 15:59:58.743099995 (486h49m33.51374133s) [upload=389390]: Uploading segments... Jul 13 15:59:58.743128329 (486h49m33.513769654s) [upload=389390]: Got next segment. Inline: true Jul 13 15:59:58.743131555 (486h49m33.51377288s) [upload=389390]: Waiting for error group managing segments... Jul 13 15:59:58.743157975 (486h49m33.51379931s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 15:59:58.743162384 (486h49m33.513803719s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 15:59:58.743164628 (486h49m33.513805963s) [upload=389390]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 15:59:59.052447722 (486h49m33.823089057s) [upload=389390]: Done uploading segments... Jul 13 15:59:59.052459595 (486h49m33.82310092s) [upload=389390]: Upload finished. err: <nil> Jul 13 16:00:47.777149861 (486h50m22.547791186s) [upload=389402]: Starting upload Jul 13 16:00:47.777208903 (486h50m22.547850238s) [upload=389402]: Done starting upload Jul 13 16:00:47.777265191 (486h50m22.547906516s) [upload=389402]: Uploading segments... Jul 13 16:00:47.777297553 (486h50m22.547938888s) [upload=389402]: Got next segment. Inline: true Jul 13 16:00:47.777301380 (486h50m22.547942715s) [upload=389402]: Waiting for error group managing segments... Jul 13 16:00:47.777333241 (486h50m22.547974576s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:00:47.777339402 (486h50m22.547980737s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:00:47.777341748 (486h50m22.547983083s) [upload=389402]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:00:48.315202595 (486h50m23.08584393s) [upload=389402]: Done uploading segments... Jul 13 16:00:48.315221921 (486h50m23.085863246s) [upload=389402]: Upload finished. err: <nil> Jul 13 16:01:41.500642721 (486h51m16.271284056s) [upload=389416]: Starting upload Jul 13 16:01:41.500744706 (486h51m16.271386041s) [upload=389416]: Done starting upload Jul 13 16:01:41.500806174 (486h51m16.271447509s) [upload=389416]: Uploading segments... Jul 13 16:01:41.500837604 (486h51m16.271478939s) [upload=389416]: Got next segment. Inline: true Jul 13 16:01:41.500841311 (486h51m16.271482646s) [upload=389416]: Waiting for error group managing segments... Jul 13 16:01:41.500874174 (486h51m16.271515509s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jul 13 16:01:41.500878933 (486h51m16.271520258s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jul 13 16:01:41.500881377 (486h51m16.271522712s) [upload=389416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jul 13 16:01:41.784662533 (486h51m16.555303868s) [upload=389416]: Done uploading segments... Jul 13 16:01:41.784680327 (486h51m16.555321652s) [upload=389416]: Upload finished. err: <nil>
Duration: 30.001094098s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
6.740341665s
FAIL (2025-07-13 16:03:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.740506881s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
11.491428086s
FAIL (2025-07-13 16:02:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 11.491452604s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.443797141s
FAIL (2025-07-13 16:02:06 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.443830184s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X.............X.............................................] duration:
6.303913393s
FAIL (2025-07-13 16:01:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.303942841s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.645378185s
FAIL (2025-07-13 16:01:34 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.645403214s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X.............X............................................] duration:
6.285386124s
FAIL (2025-07-13 16:00:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.285409168s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.922996287s
FAIL (2025-07-13 16:00:23 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.923024329s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X.............X...........................................] duration:
6.4389528s
FAIL (2025-07-13 15:59:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.43897394s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.545219835s
FAIL (2025-07-13 15:59:27 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.545241737s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X.............X..........................................] duration:
6.305473072s
FAIL (2025-07-13 15:59:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.305495634s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.409340805s
FAIL (2025-07-13 15:58:39 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.409365964s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.358425468s
FAIL (2025-07-13 15:58:22 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.358446638s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X.............X.........................................] duration:
6.054430459s
FAIL (2025-07-13 15:58:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.054454004s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.432567723s
FAIL (2025-07-13 15:57:43 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.432590527s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X.............X........................................] duration:
6.046341205s
FAIL (2025-07-13 15:57:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.046361863s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X.............X.......................................] duration:
6.026924851s
FAIL (2025-07-13 15:56:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.027017608s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.39550681s
FAIL (2025-07-13 15:56:34 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.395977471s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.............X......................................] duration:
6.053619132s
FAIL (2025-07-13 15:56:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.053643619s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.............X.....................................] duration:
6.095701628s
FAIL (2025-07-13 15:56:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.095723079s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.509335383s
FAIL (2025-07-13 15:55:49 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.50936027s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.............X....................................] duration:
6.205562601s
FAIL (2025-07-13 15:55:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.205621965s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.320185569s
FAIL (2025-07-13 15:55:19 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.320201017s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.............X...................................] duration:
6.095088625s
FAIL (2025-07-13 15:54:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.095110988s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.451980743s
FAIL (2025-07-13 15:54:43 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.452000921s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X.............X..................................] duration:
5.964642703s
FAIL (2025-07-13 15:53:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.964666309s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.42310597s
FAIL (2025-07-13 15:53:30 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.423349566s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X.............X.................................] duration:
6.038520273s
FAIL (2025-07-13 15:52:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.038538057s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.386051609s
FAIL (2025-07-13 15:52:32 UTC)
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.386073292s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X.............X................................] duration:
6.263929774s
FAIL (2025-07-13 15:52:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.263957568s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X.............X...............................] duration:
6.306826485s
FAIL (2025-07-13 15:51:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.306851182s
edge
gateway
us-select-1
|